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Section 1 


Introduction 


Introduction 


The Common Core State Standards (CCSS) are a set of academic 
standards in mathematics and English language arts/literacy that are 
grounded in evidence and designed to ensure that all students have 
the academic knowledge and skills they need in these core subjects 
to succeed after high school. The CCSS were developed in a state- 
led process under the leadership of governors and chief state school 
officers and participation from 48 states. The process included the 
involvement of state departments of education, districts, teachers, 
community leaders, experts in a wide array of fields and professional 
educator organizations. 

A good place to begin to understand the CCSS is through a study 
of the standards themselves and the key instructional shifts required 
in each discipline. In English language arts/literacy, students will be 
exposed to a balance of literary and informational texts to build a 
growing base of knowledge and will be expected to cite evidence 
from within the texts in order to answer questions and develop written 
or verbal responses. Students will also be expected to develop facility 
with academic language and read texts that increase in complexity 
as they progress so that all students are ready for the demands 
of college- and career-level reading no later than the end of high 
school. The instructional shifts in English language arts/literacy are as 
follows: 1 

1 . Complexity: Regular practice with complex text and its 
academic language 

2. Evidence: Reading, writing, and speaking grounded in 
evidence from text, both literary and informational 

3. Knowledge: Building knowledge through content-rich 
non-fiction 


Focus and coherence are the two major evidence-based design 
principles of the Common Core State Standards for Mathematics. 2 
These principles are meant to fuel greater achievement in a deep 
and rigorous curriculum, one in which students acquire conceptual 
understanding, procedural skill and fluency, and the ability to apply 
mathematics to solve problems. Thus, the instructional shifts in 
mathematics are as follows: 3 

1 . Focus strongly where the Standards focus 

2. Coherence: Think across grades and link to major topics within 
the grade 

3. Rigor: In major topics, pursue conceptual understanding, 
procedural skill and fluency, and application with equal intensity. 

To ensure that all students are able to meet these high expectations, 
educators need access to high-quality and well-aligned instructional 
and assessment materials. In support of the work being done by both 
educators and developers to meet this need, Achieve, the Council of 
Chief State School Officers and Student Achievement Partners have 
developed this Toolkit for Evaluation Alignment of Instructional and 
Assessment Materials. The purpose of the Toolkit is to catalyze the 
impact that the CSSS can have on student achievement by increasing 
the prevalence of CCSS-aligned, high-quality instructional and 
assessment materials. 


1. For more information about the shifts in English language arts/literacy, see 
achievethecore.org/elalitshifts 

2. For some of the sources of evidence consulted during the standards development process, see 
pp 91-93 of CCSSM. 

3. For more information about the shifts in mathematics, see achievethecore.org/mathshifts 
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Section 2 


Instructional Materials 
Evaluation Toolkit (IMET) 


6 ELA/Literacy, Grades K-2 

61 ELA/Literacy, Grades 3-12 

118 Mathematics, Grades K-8 

159 Mathematics, High School 


Instructional Materials 
Evaluation Toolkit (IMET) 


ELA/Literacy, K-2 


Instructional Materials Evaluation Tool 

ELA/Literacy, Grades K-2 

What Are the Purposes of the IMET? 

This ELA/Literacy IMET is designed to help educators determine whether 
or not instructional materials are aligned to the Shifts and major features of 
the Common Core State Standards (CCSS). The substantial instructional 
Shifts (http://www.corestandards.org/other-resources/key-shifts-in-english- 
language-arts/) at the heart of the Common Core State Standards are: 

• Complexity: Regular practice with complex text and its 
academic language 

• Evidence: Reading, writing, and speaking grounded in evidence 
from text, both literary and informational 

• Knowledge: Building knowledge through content-rich non-fiction 
The IMET draws directly from the following documents: 

• Common Core State Standards for English Language Arts & Literacy 

in History/Social Studies, Science, and Technical Subjects (http://www. 
corestandards.org/ELA-Literacy/) 

• Publishers’ Criteria for the Common Core State Standards in ELA/ 
literacy grades K-2 (http://corestandards.org/assets/Publishers_Criteria_ 
for_K-2.pdf) 

• Supplement to Appendix A of the Common Core State Standards for 
ELA/Literacy: New Research on Text Complexity ( 
http://www.corestandards.org/assets/E0813_Appendix_A_New_ 
Research_on_Text_Complexity.pd1) 

When to use the IMET 

1 . Purchasing materials: Many factors go into local purchasing 
decisions. Alignment to the Standards is a critical factor to 


consider. This tool is designed to evaluate alignment of 
instructional materials to the Shifts and the major features of 
the CCSS. It also provides suggestions of additional indicators 
to consider in the materials evaluation and purchasing process. 

2. Evaluating materials currently in use: The IMET can be used 
to analyze the degree of alignment of existing materials and 
help to highlight specific, concrete flaws in alignment. Even 
where materials and tools currently in use fail to meet one 
or more of these criteria, the pattern of failure is likely to be 
informative. States and districts can use the evaluation to create 
a thoughtful plan to modify or combine existing resources in 
such a way that students’ actual learning experiences approach 
the complexity, evidence and knowledge-building of the 
Standards. 

3. Developing materials: Those developing new materials locally 
can use this tool as guidance for creating aligned ELA/literacy 
curricula. 

Please note this tool was designed for evaluating comprehensive 
curricula (including any supplemental or ancillary materials), but it was 
not designed for the evaluation of standalone supplemental materials. 

Who Uses the IMET? 

Evaluating instructional materials requires both subject matter 
and pedagogical expertise. Evaluators should be well versed in 
the Standards (http://www.corestandards.org/ELA-Literacy/) for 
all grades in which materials are being evaluated. Evaluators also 
should be familiar with the substantial instructional Shifts (http://www. 
corestandards.org/other-resources/key-shifts-in-english-language- 
arts/) of Complexity, Evidence and Knowledge that are listed above. 


The IMET was developed by Student Achievement Partners. Educators may use or adapt, ©creative 


http://creativecommons.Org/licenses/by/3.0/ 


Download this tool at http://achievethecore.org/IMET 
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Getting Started 


Prior to Evaluation 

Assemble all of the materials necessary for the evaluation. In addition, 
each evaluator should have a reference copy of the Common Core 
State Standards for ELA/Literacy and the Publishers’ Criteria for the 
Common Core State Standards in ELA/Literacy grades K - 2. 

Before conducting the evaluation itself, it is important to develop a 
protocol for the evaluation process. The protocol should include having 
evaluators study the Publishers’ Criteria and the IMET. It will also be 
helpful for evaluators to get a sense of each program overall before 
beginning the process. 

Sections 1 - 3 below should be completed to produce a 
comprehensive picture of the strengths and weaknesses of the 
materials under evaluation. Information about areas in need of 
improvement or supplementation should be shared with internal and 
external stakeholders. 


Navigating the Tool 

Begin with Section 1: Non-Negotiable Alignment Criteria (p. 9) 

• The Non-Negotiable Alignment Criteria must each be met in 
full for materials to be considered aligned to the Shifts and the 
major features of the Common Core State Standards. Each Non- 
Negotiable Alignment Criterion has one or more metrics 
associated with it; every one of these metrics must be met in 
order for the criterion as a whole to be met. 

• Examine the relevant materials and use evidence to rate the 
materials against each criterion and its associated metrics. 


• Record and explain the evidence upon which the rating 
is based 

Continue to Section 2: Alignment Criteria (p. 17) 

• The Alignment Criteria must each be met for materials to be 
considered aligned to the Shifts and the major features of the 
Common Core State Standards. Each Alignment Criterion has 
one or more metric associated with it; a specific number of these 
metrics must be met or partially met in order for the criterion as a 
whole to be met. 

• Examine the materials in relation to these criteria, assigning each 
metric a point value. Rate each criterion as “Meets” or “Does Not 
Meet” based on the number of points assigned. The more points 
the materials receive on the Alignment Criteria, the better they 
are aligned. 

• Record and explain the evidence upon which the rating is based. 

Complete Section 3: Evaluation Summary (p. 58) 

• Compile all of the results from Sections 1 and 2 to determine 

if the instructional materials are aligned to the Shifts and major 
features of the CCSS. 

Proceed to Section 4: Indicators of Quality (p. 60) 

• Indicators of Quality are important considerations that will help 
evaluators better understand the overall quality of intructional 
materials. These considerations are not for alignment to 

the CCSS, but they provide valuable information about additional 
curricula characteristics. Evaluators may want to add their own 
indicators to the examples provided. 


The IMET was developed by Student Achievement Partners. Educators may use or adapt, ©creative 


http://creativecommons.Org/licenses/by/3.0/ 


Download this tool at http://achievethecore.org/IMET 
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Directions for Non-Negotiable 1 

Complexity of Texts 


SECTION 2 

Instructional Materials Evaluation Toolkit (IMET) 

ELA/Literacy, Grades K-2 


Non-Negotiable 1 : ELA/literacy texts have the appropriate level of complexity for the grade, according to 
both quantitative measures and qualitative analysis of text complexity— texts are worthy of student time 
and attention. 


Intended for anchor texts read aloud by the teacher in grades 
K - 1 . Anchor texts are texts designed to be the center of attention 
for development of reading comprehension. Evaluations of text 
complexity are only applicable to grade 2 student reading material. 
For student reading materials in grades K - 1 refer to the Alignment 
Criteria for Foundational Skills 4B and 4D. 

Required Materials 

• Teacher’s edition and student materials 

• Appendix A pages 1 - 1 0 for more on the vital role text 
complexity plays in the CCSS (http://www.corestandards.org/ 
assets/Appendix_A.pdf) 

• Supplement to Appendix A: New Research on Text Complexity 
(http://www.corestandards.org/assets/E0813_Appendix_A_ 
New_Research_on_Text_Complexity.pdf) 


Rating this Criterion 

Non-Negotiable Alignment Criteria are defined as the set of criteria 
that must be met in full for materials to be considered aligned to the 
Shifts and the major features of the Common Core State Standards. 
Each metric of a Non-Negotiable Alignment Criterion must be met in 
order for the criterion to be met. 

1 . Evaluate carefully how completely the submission meets each 
of the metrics for this Criterion below. 

2. Provide specific examples of evidence in support of the rating, 
including pointing out specific gaps in the materials. 

3. When the section is finished, if any one of the metrics is rated 
as Does Not Meet, then rate the overall Non-Negotiable 1 as 
Does Not Meet. If all metrics are rated as Meets, then rate the 
overall Non-Negotiable 1 as Meets. 


Published v.2 201 4 - send feedback to info@studentsachieve.net Reviewer Initials: 


Title of Program: 


9 


Non-Negotiable 1 

Complexity of Texts 


Metric 


NN Metric 1A: 

100% of anchor texts must be accompanied 
by specific evidence that they have been 
analyzed with at least one research-based 
quantitative measure. Read-aloud texts 
should measure within or above the grades 2 
- 3 band. Second grade anchor texts should 
measure within the grades 2-3 band. 


How to Find the Evidence 


Look for a publisher-supplied list of all texts 
in the submission with their quantitative 
measures. 

District conducts evaluation of all texts in the 
submission. 

Look for other evidence that texts have been 
measured by a quantitative measure. 


Published v.2 2014 - send feedback to info@studentsachieve.net 


Reviewer Initials: 


SECTION 2 

Instructional Materials Evaluation Toolkit (IMET) 

ELA/Literacy, Grades K-2 


Evidence 


Rating 


□ 

□ 


Meets 

Does Not Meet / Insufficient Evidence 


Title of Program: 
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Non-Negotiable 1 

Complexity of Texts 


Metric 

How to Find the Evidence 

NN Metric IB: 

100% of texts must be accompanied by 
specific evidence that they have been 
analyzed for their qualitative features 
indicating a specific grade level placement. 

Look for a publisher-supplied list of all texts 
in the submission with their qualitative 
measures. 

District conducts evaluation of all texts in the 
submission. 

Look for other evidence that texts have been 
qualitatively analyzed. 


Published v.2 201 4 - send feedback to info@studentsachieve.net Reviewer Initials: 


SECTION 2 

Instructional Materials Evaluation Toolkit (IMET) 

ELA/Literacy, Grades K-2 


Evidence 


Rating 


□ 

□ 


Meets 

Does Not Meet / Insufficient Evidence 


Title of Program: 
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SECTION 2 

Instructional Materials Evaluation Toolkit (IMET) 

ELA/Literacy, Grades K-2 

Non-Negotiable 1 : ELA/literacy texts have the appropriate level of complexity for the grade, according to 
both quantitative measures and qualitative analysis of text complexity— texts are worthy of student time 
and attention. 


Non-Negotiable 1 

Complexity of Texts 


Rating for Non-Negotiable 1 


Rating 


If both metrics were rated as Meets, then rate Non-Negotiable 1 as Meets. If one or more metrics were rated as Does Not Meet, 
then rate Non-Negotiable 1 as Does Not Meet. 

Check the final rating. Then, briefly describe the strengths and weaknesses of these materials in light of this Criterion. 


□ Meets 

□ Does Not Meet 


Strengths/Weaknesses: 


Before moving to Non-Negotiable 2, record the final Meets or Does Not Meet rating in the Evaluation Summary on Page 58. 


Published v.2 201 4 - send feedback to info@studentsachieve.net Reviewer Initials: 


Title of Program: 
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Directions for Non-Negotiable 2 

Text-Dependent and Text-Specific Questions 


SECTION 2 

Instructional Materials Evaluation Toolkit (IMET) 

ELA/Literacy, Grades K-2 


Non-Negotiable 2: At least 80% of all questions in the submission are high-quality text-dependent 
and text-specific questions. The overwhelming majority of these questions are text-specific and draw 
student attention to the text. 


Related to texts read aloud by the teacher in grades K-2 and 
student reading materials beginning in grade 2 only. For questions/ 
tasks related to student reading materials in grades K - 1 refer to the 
Alignment Criterion for Foundational Skills. 

Required Materials 

• Teacher’s edition and student materials 

• Appropriate grade level set of ELA/Literacy Standards 

• Tools for evaluating the quality of text-dependent questions 

(http://achievethecore.org/page/71 0/text-dependent-question- 
resources) 


1 . Evaluate carefully how completely the submission meets each 
of the Criteria below. 

2. Provide specific examples of evidence in support of the rating, 
including pointing out specific gaps in the materials. 

3. When the section is finished, if any one of the metrics is rated 
as Does Not Meet, then rate the overall Non-Negotiable 2 as 
Does Not Meet. If all metrics are rated as Meets, then rate the 
overall Non-Negotiable 2 as Meets. 


Rating this Criterion 

Non-Negotiable Alignment Criteria are defined as the set of criteria 
that must be met in full for materials to be considered aligned to the 
Shifts and the major features of the Common Core State Standards. 
Each subcomponent of a Non-Negotiable Alignment Criterion must be 
met in order for the criterion to be met. 


Published v.2 201 4 - send feedback to info@studentsachieve.net Reviewer Initials: 


Title of Program: 
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Non-Negotiable 2 

Text-Dependent and Text-Specific Questions 


Metric 

How to Find the Evidence 

NN Metric 2A: 

Eighty percent of questions and tasks are 
text -dependent to reflect the requirements 
of Reading Standard 1 (by requiring use of 
textual evidence to support valid inferences 
from the text). 

Analyze a large* sample set of questions 
from across the submission, including 
culminating tasks and extended response 
tasks, and evaluate them for text 
dependency/text specificity and require 
readers to produce evidence. 

‘Recommendation: analyze one in every four 
sets of questions and tasks completely to 
get a valid sample size. 


Published v.2 201 4 - send feedback to info@studentsachieve.net Reviewer Initials: 


SECTION 2 

Instructional Materials Evaluation Toolkit (IMET) 

ELA/Literacy, Grades K-2 


Evidence 


Rating 


□ 

□ 


Meets 

Does Not Meet / Insufficient Evidence 


Title of Program: 
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Non-Negotiable 2 

Text-Dependent and Text-Specific Questions 


Metric 


NN Metric 2B: 

Questions and tasks accurately address the 
analytical thinking required by the Standards 
at each grade level. NOTE: while multiple 
Standards will be addressed with every text, 
not every Standard must be assessed with 
every text. 


How to Find the Evidence 


Look for publisher-produced alignment 
documentation of the standards addressed 
by specific questions and tasks. 

Analyze the same large* sample set of 
questions from across the submission, 
including culminating tasks and extended 
response tasks and evaluate which 
Standard(s) each meets. 

‘Recommendation: analyze one in every four 
sets of questions and tasks completely to 
get a valid sample size. 


Published v.2 2014 - send feedback to info@studentsachieve.net 


Reviewer Initials: 


SECTION 2 

Instructional Materials Evaluation Toolkit (IMET) 

ELA/Literacy, Grades K-2 


Evidence 


Rating 


□ 

□ 


Meets 

Does Not Meet / Insufficient Evidence 


Title of Program: 
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SECTION 2 

Instructional Materials Evaluation Toolkit (IMET) 

ELA/Literacy, Grades K-2 

Non-Negotiable 2: At least 80% of all questions in the submission are high-quality text-dependent 
and text-specific questions. The overwhelming majority of these questions are text-specific and draw 
student attention to the text. 


Non-Negotiable 2 

Text-Dependent and Text-Specific Questions 


Rating for Non-Negotiable 2 


Rating 


If both metrics were rated as Meets, then rate Non-Negotiable 2 as Meets. If one or more metrics were rated as Does Not Meet, 
then rate Non-Negotiable 2 as Does Not Meet. Check the final rating. 

Then, briefly describe the strengths and weaknesses of these materials in light of this Criterion. 


] Meets 

□ Does Not Meet 


Strengths / Weaknesses: 


Before moving to Alignment Criterion 1, record the final Meets or Does Not Meet rating in the Evaluation Summary on Page 58. 


Now continue by evaluating the Alignment Criterion 1 for Range and Quality of Texts 


Published v.2 201 4 - send feedback to info@studentsachieve.net Reviewer Initials: 


Title of Program: 
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Directions for Alignment Criterion 1 

Range and Quality of Texts 

Alignment Criterion 1: Materials must reflect the distribution of text types and genres required by the 
Standards. 

Required Materials 

• Teacher’s edition and student materials 

• Appropriate grade level set of ELA/Literacy Standards 


SECTION 2 

Instructional Materials Evaluation Toolkit (IMET) 

ELA/Literacy, Grades K-2 


Rating this Criterion 

1 . Rate how well the submission meets each of the Criteria 
below. Ratings are Meets (2 points), Partially Meets (1 point), or 
Does Not Meet (0 points). 

2. Provide specific examples of evidence in support of the rating, 
including pointing out specific gaps in the materials. 

3. When the section is finished, add up the rating and enter it at 
the bottom of the section. A rating of at least 7 out of 10 points 
means that the materials have met this Alignment Criterion. 

4. Lastly, record the rating Meets, Does Not Meet or Not 
Applicable for this section in the Evaluation Summary on page 
58 before proceeding to Alignment Criterion 2. The more points 
the materials receive on the Alignment Criteria, the better they 
are aligned. 


Published v.2 201 4 - send feedback to info@studentsachieve.net Reviewer Initials: 


Title of Program: 
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Alignment Criterion 1 

Range and Quality of Texts 


Metric 


AC Metric 1A: 

Materials pay careful attention to providing 
a sequence or collection of texts that build 
knowledge systematically through reading, 
writing, listening and speaking about topics 
under study, particularly for texts read aloud 
by the teacher in grades K - 2 and student 
reading materials in grade 2. 


How to Find the Evidence 


Examine the table of contents at each grade 
level to see if the collection is carefully 
sequenced and organized with the aim of 
increasing knowledge on several topics of 
focused inquiry. 

Other evidence as appropriate. 


Published v.2 2014 - send feedback to info@studentsachieve.net 


Reviewer Initials: 


SECTION 2 

Instructional Materials Evaluation Toolkit (IMET) 

ELA/Literacy, Grades K-2 


Evidence 


Rating 


] Meets (2) 

] Partially Meets (1) 
I I Does Not Meet (0) 


Title of Program: 
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Alignment Criterion 1 

Range and Quality of Texts 


Metric 


How to Find the Evidence 


AC Metric IB: Evaluate sample lessons to ensure they call 

Within a sequence or collection of texts, for careful reading through the instructions 

specific anchor texts of grade level offered to teachers and students. 

complexity (keystone texts) are selected for 

their quality as being worthy of especially 

careful reading. This may be for texts read 

aloud by the teacher and for student reading 

materials in grade 2. Other texts in the 

collection can and should vary widely in 

complexity to accommodate a full range of 

student independent reading ability. 


Published v.2 2014 - send feedback to info@studentsachieve.net 


Reviewer Initials: 


SECTION 2 

Instructional Materials Evaluation Toolkit (IMET) 

ELA/Literacy, Grades K-2 


Evidence 


Rating 


] Meets (2) 

] Partially Meets (1) 
I I Does Not Meet (0) 


Title of Program: 
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Alignment Criterion 1 

Range and Quality of Texts 


Metric 

How to Find the Evidence 

AC Metric 1C: 

Look for a list of all the texts selected for 

In grades K-2, literacy programs shift the 
balance of texts and instructional time to 
50% high quality literature / 50% content- 
rich informational text. 

submission with this information clearly 
provided and summarized. 


Published v.2 201 4 - send feedback to info@studentsachieve.net Reviewer Initials: 


SECTION 2 

Instructional Materials Evaluation Toolkit (IMET) 

ELA/Literacy, Grades K-2 


Evidence 


Rating 


] Meets (2) 

] Partially Meets (1) 
] Does Not Meet (0) 


Title of Program: 
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Alignment Criterion 1 

Range and Quality of Texts 


Metric 


How to Find the Evidence 


AC Metric ID: Look for a list of all the texts selected for 

Texts included in instructional materials submission with this information provided, 

include and reflect the text characteristics 
and genres that are specifically required by 
the Standards at each grade level. 


Published v.2 2014 - send feedback to info@studentsachieve.net 


Reviewer Initials: 


SECTION 2 

Instructional Materials Evaluation Toolkit (IMET) 

ELA/Literacy, Grades K-2 


Evidence 


Rating 


] Meets (2) 

] Partially Meets (1) 
] Does Not Meet (0) 


Title of Program: 
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Alignment Criterion 1 

Range and Quality of Texts 


SECTION 2 

Instructional Materials Evaluation Toolkit (IMET) 

ELA/Literacy, Grades K-2 


Metric 


How to Find the Evidence Evidence 


AC Metric 1 E: Examine a representative sample of texts or 

Student reading materials markedly increase the description of the supplemental materials 

the opportunity for regular independent to evaluate. 

reading of texts that develop foundational 

skills, build knowledge, and increase student 

ability with complex texts. 


Rating 


] Meets (2) 

] Partially Meets (1) 
I I Does Not Meet (0) 


Published v.2 2014 - send feedback to info@studentsachieve.net 


Reviewer Initials: 


Title of Program: 
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Alignment Criterion 1 

Range and Quality of Texts 


SECTION 2 

Instructional Materials Evaluation Toolkit (IMET) 

ELA/Literacy, Grades K-2 


Alignment Criterion 1: Materials must reflect the distribution of text types and genres required by the 
Standards. 


Points Assigned for Alignment Criterion 1 

Rating 

Materials must earn at least 7 out of 10 points to meet Alignment Criterion 1 . If materials earn less than 7 points, the Criterion 
has not been met. Check the final rating. 

Total (10 points possible) 

Then, briefly describe the strengths and weaknesses of these materials in light of this Criterion. 

] Meets 
] Does Not Meet 


Strengths / Weaknesses: 


Before moving to Alignment Criterion 2, record the final Meets or Does Not Meet rating in the Evaluation Summary on Page 58. 

Published v.2 2014 - send feedback to info@studentsachieve.net Reviewer Initials: Title of Program: 23 


Directions for Alignment Criterion 2 

Questions Support Student Learning 


SECTION 2 

Instructional Materials Evaluation Toolkit (IMET) 

ELA/Literacy, Grades K-2 


Alignment Criterion 2: Questions support students in building reading comprehension, in finding and 
producing the textual evidence to support their responses, and in developing grade level academic language. 


4. Lastly, record the rating Meets, Does Not Meet or Not 
Applicable for this section in the Evaluation Summary on page 
58 before proceeding to Alignment Criterion 3. The more points 
the materials receive on the Alignment Criteria, the better they 
are aligned. 

• Tools for evaluating the quality of text dependent questions 
(http://achievethecore.org/page/71 0/text-dependent-question- 
resources) 


Required Materials 

• Teacher’s edition and student materials 

• Appropriate grade level set of ELA/Literacy Standards 


Rating this Criterion 

1 . Rate how well the submission meets each of the Criteria 
below. Ratings are Meets (2 points), Partially Meets (1 point), or 
Does Not Meet (0 points). 

2. Provide specific examples of evidence in support of the rating, 
including pointing out specific gaps in the materials. 

3. When the section is finished, add up the rating and enter it at 
the bottom of the section. A rating of at least 4 out of 6 points 
means that the materials have met this Alignment Criterion. 


Published v.2 201 4 - send feedback to info@studentsachieve.net Reviewer Initials: 


Title of Program: 
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Alignment Criterion 2 

Questions Support Student Learning 


Metric 


AC Metric 2A: 

High-quality sequences of text-dependent 
questions can address any of the following: 
sustained attention to making meaning from 
the text, rereading to gain evidence and 
clarity, and the acquisition of foundational 
skills. 


How to Find the Evidence 


Analyze a large* sample of questions 
from different grade levels/sections of the 
program. 

‘Recommendation: analyze one in every four 
sets of questions and tasks completely to 
get a valid sample size 


Published v.2 2014 - send feedback to info@studentsachieve.net 


Reviewer Initials: 


SECTION 2 

Instructional Materials Evaluation Toolkit (IMET) 

ELA/Literacy, Grades K-2 


Evidence 


Rating 


] Meets (2) 

] Partially Meets (1) 
I I Does Not Meet (0) 


Title of Program: 
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Alignment Criterion 2 

Questions Support Student Learning 


Metric 

How to Find the Evidence 

AC Metric 2B: 

Questions and tasks support students 
in acquiring the academic language 
(vocabulary and syntax) prevalent in 
complex texts. 

Analyze a large* sample of questions 
and tasks to see that there are regularly 
questions asking students to address the 
meaning of academic vocabulary and to 
unpack complex sentences. 

'Recommendation: analyze one in every four 
sets of questions and tasks completely to 
get a valid sample size. 
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Rating 


□ Meets (2) 

] Partially Meets (1) 
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Alignment Criterion 2 

Questions Support Student Learning 


Metric 


How to Find the Evidence 


AC Metric 2C: Analyze a large sample* of questions and 

Questions build to a deep understanding of tasks to see they address the central ideas 
the central ideas of the text. of the text. Take particular note to see if 

they support students’ ability to address the 
culminating task. 

‘Recommendation: analyze one in every four 
sets of questions and tasks completely to 
get a valid sample size. 


Published v.2 2014 - send feedback to info@studentsachieve.net 


Reviewer Initials: 


SECTION 2 

Instructional Materials Evaluation Toolkit (IMET) 

ELA/Literacy, Grades K-2 


Evidence 


Rating 


] Meets (2) 

] Partially Meets (1) 
] Does Not Meet (0) 


Title of Program: 


27 


Alignment Criterion 2 

Questions Support Student Learning 


SECTION 2 

Instructional Materials Evaluation Toolkit (IMET) 

ELA/Literacy, Grades K-2 


Alignment Criterion 2: Questions support students in building reading comprehension, in finding and 
producing the textual evidence to support their responses, and in developing grade level academic 
language. 


Points Assigned for Alignment Criterion 2 

Rating 

Materials must earn at least 4 out of 6 points to meet Alignment Criterion 2. If materials earn less than 4 points, the Criterion has 
not been met. Check the final rating. 

Total (6 points possible) 

Then, briefly describe the strengths and weaknesses of these materials in light of this Criterion. 

] Meets 

] Does Not Meet 


Strengths / Weaknesses: 


Before moving to Alignment Criterion 3, record the final Meets or Does Not Meet rating in the Evaluation Summary on Page 58. 
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Directions for Alignment Criterion 3 

Writing to Sources and Research 

Alignment Criterion 3: Written tasks at all grade levels require students to confront the text directly, to 
draw on textual evidence, and to support valid inferences from the text. 

Required Materials 

• Teacher’s edition and student materials 

• Appropriate grade level set of ELA/Literacy Standards 


SECTION 2 

Instructional Materials Evaluation Toolkit (IMET) 

ELA/Literacy, Grades K-2 


Rating this Criterion 

1 . Rate how well the submission meets each of the Criteria 
below. Ratings are Meets (2 points), Partially Meets (1 point), or 
Does Not Meet (0 points). 

2. Provide specific examples of evidence in support of the rating, 
including pointing out specific gaps in the materials. 

3. When the section is finished, add up the rating and enter it at 
the bottom of the section. A rating of at least 6 out of 8 points 
means that the materials have met this Alignment Criterion. 

4. Lastly, record the rating Meets, Does Not Meet or Not 
Applicable for this section in the Evaluation Summary on page 
58 before proceeding to Alignment Criterion 4. The more points 
the materials receive on the Alignment Criteria, the better they 
are aligned. 


Published v.2 201 4 - send feedback to info@studentsachieve.net Reviewer Initials: 


Title of Program: 


29 


Alignment Criterion 3 

Writing to Sources and Research 


Metric 


How to Find the Evidence 


AC Metric 3A: 

Writing to sources is a key task. Students 
are asked in their writing to analyze and 
synthesize sources, as well as to present 
careful analysis, well-defended claims and 
clear information. Materials are organized 
to elicit responses to sources in age- 
appropriate ways (could include activities 
such as dictation, making pictures to 
express thoughts, etc., in addition to writing). 


Examine a sampling (minimum 8 per grade) 
of the writing tasks for each section, listing 
any tasks or items that do not require writing 
to sources. Calculate a percentage of 
aligned tasks. For alignment, three-quarters 
of tasks should require writing to sources. 
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Rating 
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Alignment Criterion 3 

Writing to Sources and Research 


Metric 


How to Find the Evidence 


AC Metric 3B: 

Materials create prominent and varied 
opportunities for opinion, informative/ 
explanatory and narrative writing 


Examine the table of contents to see if they 
match up with this distribution. When the 
title does not clearly indicate what type of 
writing look at the assignment itself. 
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] Does Not Meet (0) 


Title of Program: 


31 


Alignment Criterion 3 

Writing to Sources and Research 


Metric 

How to Find the Evidence 

AC Metric 3C: 

Extensive practice with short, focused, grade 
appropriate research projects is provided. 
Materials require students to engage in many 
short research projects annually. 

Examine the table of contents to see the 
frequency of these assignments. 

Alternately, examine the Index to see the 
frequency of “research” as a term. Spot 
check % of those page references to gauge 
frequency and quality of instructional 
guidance. Read the instructions to see they 
are in fact short*. 

‘Short research projects would be no more than a week. 
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Instructional Materials Evaluation Toolkit (IMET) 

ELA/Literacy, Grades K-2 


Evidence 


Rating 
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Alignment Criterion 3 

Writing to Sources and Research 


SECTION 2 

Instructional Materials Evaluation Toolkit (IMET) 

ELA/Literacy, Grades K-2 


Alignment Criterion 3: Written tasks at all grade levels require students to confront the text directly, to 
draw on textual evidence, and to support valid inferences from the text. 


Points Assigned for Alignment Criterion 3 

Rating 

Materials must earn at least 6 out of 8 points to meet Alignment Criterion 3. If materials earn less than 6 points, the Criterion has 
not been met. Check the final rating. 

Total (8 points possible) 

Then, briefly describe the strengths and weaknesses of these materials in light of this Criterion. 

] Meets 
] Does Not Meet 


Strengths / Weaknesses: 


Before moving to Alignment Criterion 4, record the final Meets or Does Not Meet rating in the Evaluation Summary on Page 58. 
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Directions for Alignment Criterion 4 

Foundational Skills 

Alignment Criterion 4: Materials provide explicit and systematic instruction and diagnostic support in 
concepts of print, phonological awareness, word awareness, phonics and vocabulary, development, 
syntax, and fluency. These foundational skills are necessary and central components of an effective, 
comprehensive reading program designed to develop proficient readers with the capacity to 
comprehend texts across a range of types and disciplines. 


SECTION 2 

Instructional Materials Evaluation Toolkit (IMET) 

ELA/Literacy, Grades K-2 


Required Materials 

• Teacher’s edition and student materials 

• Refer to the to the grade-level specific Reading Standards for 
Foundations Skills (http://www.corestandards.org/ELA-Literacy/ 
RF/introduction/) 


4. Lastly, record the rating Meets, Does Not Meet or Not 
Applicable for this section in the Evaluation Summary on page 
58 before proceeding to Alignment Criterion 5. The more points 
the materials receive on the Alignment Criteria, the better they 
are aligned. 


Rating this Criterion 

1 . Rate how well the submission meets each of the Criteria 
below. Ratings are Meets (2 points), Partially Meets (1 point), or 
Does Not Meet (0 points). 

2. Provide specific examples of evidence in support of the rating, 
including pointing out specific gaps in the materials. 

3. When the section is finished, add up the rating and enter it at 
the bottom of the section. A rating of at least 6 out of 8 points 
means that the materials have met this Alignment Criterion. 
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Alignment Criterion 4 

Foundational Skills 


Metric 

How to Find the Evidence 

AC Metric 4A: 

Submissions address grade level CCSS for 
foundational skills by providing instruction in 
concepts of print, phonological awareness, 
letter recognition, phonics, word recognition 
and reading fluency in a research -based and 
transparent progression. 

Examine the table of contents to see if this 
matches up with the foundational standards 
for each of these grades. 
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Alignment Criterion 4 

Foundational Skills 


Metric 


How to Find the Evidence 


AC Metric 4B: 

Submissions include a variety of student 
reading material that allows for systematic, 
regular and frequent practice of all 
foundational skills. 


Examine instructions, questions and tasks in 
relevant foundational and other sections to 
see if this is expected. 
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Alignment Criterion 4 

Foundational Skills 


Metric 


How to Find the Evidence 


AC Metric 4C: 

Materials provide regular practice in 
encoding (spelling) and decoding (reading) 
the sound-symbol relationships of English. 


Examine the table of contents to see if this is 
addressed. Read the prefatory materials to 
see the rationale for how this is approached. 
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Alignment Criterion 4 

Foundational Skills 


Metric 


How to Find the Evidence 


AC Metric 4D: 

Materials guide students to read with 
purpose and understanding and to make 
frequent connections between acquisition of 
foundation skills and making meaning from 
reading. 


Read instructions and prefatory material 
from throughout the submission to evaluate 
how well this is done. 
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Alignment Criterion 4 

Foundational Skills 

SECTION 2 

Instructional Materials Evaluation Toolkit (IMET) 

ELA/Literacy, Grades K-2 


Alignment Criterion 4: Materials provide explicit and systematic instruction and diagnostic support in 
concepts of print, phonological awareness, word awareness, phonics and vocabulary, development, 
syntax, and fluency. These foundational skills are necessary and central components of an effective, 
comprehensive reading program designed to develop proficient readers with the capacity to 
comprehend texts across a range of types and disciplines. 


Points Assigned for Alignment Criterion 4 

Rating 

Materials must earn at least 6 out of 8 points to meet Alignment Criterion 4. If materials earn less than 6 points, the Criterion has 
not been met. Check the final rating. 

Total (8 points possible) 

Then, briefly describe the strengths and weaknesses of these materials in light of this Criterion. 

] Meets 
] Does Not Meet 


Strengths / Weaknesses: 


Before moving to Alignment Criterion 5, record the final Meets or Does Not Meet rating in the Evaluation Summary on Page 58. 
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Directions for Alignment Criterion 5 

Language 


SECTION 2 

Instructional Materials Evaluation Toolkit (IMET) 

ELA/Literacy, Grades K-2 


Alignment Criterion 5: Materials must adequately address the Language Standards for the grade. 


Required Materials 


• Teacher’s edition and student materials 

• Appropriate grade level Language Standards (http://www. 
corestandards.org/ELA-Literacy/Lyianguage-progressive-skills/) 


Rating this Criterion 

1 . Rate how well the submission meets each of the Criteria 
below. Ratings are Meets (2 points), Partially Meets (1 point), or 
Does Not Meet (0 points). 

2. Provide specific examples of evidence in support of the rating, 
including pointing out specific gaps in the materials. 

3. When the section is finished, add up the rating and enter it at 
the bottom of the section. A rating of at least 4 out of 6 points 
means that the materials have met this Alignment Criterion. 

4. Lastly, record the rating Meets, Does Not Meet or Not 
Applicable for this section in the Evaluation Summary on page 
58 before proceeding to Alignment Criterion 6. The more points 
the materials receive on the Alignment Criteria, the better they 
are aligned. 
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Alignment Criterion 5 

Language 


Metric 


How to Find the Evidence 


AC Metric 5A: Examine the sections addressing this to see 

Materials address the grammar and if instructions include this, 

language conventions specified by the 
Language Standards at each grade level. 


Published v.2 2014 - send feedback to info@studentsachieve.net 


Reviewer Initials: 


SECTION 2 

Instructional Materials Evaluation Toolkit (IMET) 

ELA/Literacy, Grades K-2 
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Alignment Criterion 5 

Language 


SECTION 2 

Instructional Materials Evaluation Toolkit (IMET) 

ELA/Literacy, Grades K-2 


Metric 


How to Find the Evidence Evidence 


AC Metric 5B: 

Materials expect students to confront their 
own error patterns in usage and conventions 
and correct them in a grade-by-grade 
pathway that results in college and career 
readiness by 1 2th grade. 


Examine the table of contents to determine if 
these are included. 

Information might also be contained in 
prefatory materials. 


Rating 


] Meets (2) 

] Partially Meets (1) 
] Does Not Meet (0) 
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Alignment Criterion 5 

Language 


SECTION 2 

Instructional Materials Evaluation Toolkit (IMET) 

ELA/Literacy, Grades K-2 


Metric 


How to Find the Evidence Evidence 


AC Metric 5C: 

Materials provide a mirror of real-world 
activities for student practice with 
natural language (e.g. mock interviews, 
presentations). 


Examine the table of contents to determine if 
these are included. 

Information might also be contained in 
prefatory materials. 


Rating 
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Alignment Criterion 5 

Language 

SECTION 2 

Instructional Materials Evaluation Toolkit (IMET) 

ELA/Literacy, Grades K-2 


Alignment Criterion 5: Materials must adequately address the Language standards for the grade. 


Points Assigned for Alignment Criterion 5 

Rating 

Materials must earn at least 4 out of 6 points to meet Alignment Criterion 5. If materials earn less than 4 points, the Criterion has 
not been met. Check the final rating. 

Total (6 points possible) 

Then, briefly describe the strengths and weaknesses of these materials in light of this Criterion. 

] Meets 
] Does Not Meet 


Strengths / Weaknesses: 


Before moving to Alignment Criterion 6, record the final Meets or Does Not Meet rating in the Evaluation Summary on Page 58. 
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Directions for Alignment Criterion 6 

Speaking and Listening 


SECTION 2 

Instructional Materials Evaluation Toolkit (IMET) 

ELA/Literacy, Grades K-2 


Alignment Criterion 6: To be CCSS-aligned, speaking and listening must be integrated into lessons, 
items, and tasks. These must reflect a progression of communication skills as outlined in the Standards. 

Required Materials 


• Teacher’s edition and student materials 

• Appropriate grade level set Speaking and Listening Standards 
(http://www.corestandards.org/ELA-Literacy/SLyintroduction/) 


Rating this Criterion 

1 . Rate how well the submission meets each of the Criteria 
below. Ratings are Meets (2 points), Partially Meets (1 point), or 
Does Not Meet (0 points). 

2. Provide specific examples of evidence in support of the rating, 
including pointing out specific gaps in the materials. 

3. When the section is finished, add up the rating and enter it at 
the bottom of the section. A rating of at least 7 out of 10 points 
means that the materials have met this Alignment Criterion. 

4. Lastly, record the rating Meets, Does Not Meet or Not 
Applicable for this section in the Evaluation Summary on page 
58 before proceeding to Alignment Criterion 7. The more points 
the materials receive on the Alignment Criteria, the better they 
are aligned. 
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Alignment Criterion 6 

Speaking and Listening 


Metric 


AC Metric 6A: 

Materials demand that students engage 
effectively in a range of conversations and 
collaborations by expressing well-supported 
ideas clearly and building on others’ ideas. 


How to Find the Evidence 


Examine the tasks and instructions in the 
relevant sections. Prefatory materials 
might also help you determine if this is 
emphasized. 
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ELA/Literacy, Grades K-2 


Evidence 


Rating 
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Alignment Criterion 6 

Speaking and Listening 


Metric 

How to Find the Evidence 

AC Metric 6B: 

Materials develop active listening skills, 
asking relevant questions, and elaborating 
on remarks of others in a grade-appropriate 
way. 

Examine the tasks and instructions in the 
relevant sections. Prefatory materials 
might also help you determine if this is 
emphasized. 
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Alignment Criterion 6 

Speaking and Listening 


Metric 

How to Find the Evidence 

AC Metric 6C: 

Materials require students to marshal 
evidence when speaking. 

Examine the tasks and instructions in the 
relevant sections. Prefatory materials 
might also help you determine if this is 
emphasized. 
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Alignment Criterion 6 

Speaking and Listening 


Metric 


How to Find the Evidence 


AC Metric 6D: Examine instructions and tasks in relevant 

Materials build in frequent opportunities sections to see if this is prevalent. 

for discussion and, through directions 

and modeling, encourage students to use 

academic language in their speech. 
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Alignment Criterion 6 

Speaking and Listening 


SECTION 2 

Instructional Materials Evaluation Toolkit (IMET) 

ELA/Literacy, Grades K-2 


Alignment Criterion 6: To be CCSS-aligned, speaking and listening must be integrated into lessons, 
items, and tasks. These must reflect a progression of communication skills as outlined in the Standards. 


Points Assigned for Alignment Criterion 6 

Rating 

Materials must earn at least 7 out of 1 0 points to meet Alignment Criterion 6. If materials earn less than 7 points, the Criterion 
has not been met. Check the final rating. 

Total (10 points possible) 

Then, briefly describe the strengths and weaknesses of these materials in light of this Criterion. 

] Meets 
] Does Not Meet 


Strengths / Weaknesses: 


Before moving to Alignment Criterion 7, record the final Meets or Does Not Meet rating in the Evaluation Summary on Page 58. 
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Directions for Alignment Criterion 7 

Access to the Standards for All Students 


SECTION 2 

Instructional Materials Evaluation Toolkit (IMET) 

ELA/Literacy, Grades K-2 


Alignment Criterion 7: Materials must provide thoughtful supports/scaffolds to support all students in 
accessing the CCSS. 


Because the Standards are for all students, alignment requires 
thoughtful support to ensure all students are able to meet the same 
Standards. Thus, materials must provide supports for English 
Language Learners and other special populations. 


4. Lastly, record the rating Meets, Does Not Meet or is Not 
Applicable for this section in the Evaluation Summary on page 
58. The more points the materials receive on the Alignment 
Criteria, the better they are aligned. 


Required Materials 

• Teacher’s edition and student materials 

• If the submission has formative assessments and supplemental 
support materials as separate documents, gather them prior to 
evaluating this critical Alignment Criterion. 


Rating this Criterion 

1 . Rate how well the submission meets each of the Criteria 
below. Ratings are Meets (2 points), Partially Meets (1 point), or 
Does Not Meet (0 points). 

2. Provide specific examples of evidence in support of the rating, 
including pointing out specific gaps in the materials. 

3. When the section is finished, add up the rating and enter it at 
the bottom of the section. A rating of at least 8 out of 10 points 
means that the materials have met this Alignment Criterion. 
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Alignment Criterion 7 

Access to the Standards for All Students 


Metric 


How to Find the Evidence 


AC Metric 7A: 

Do the materials regularly provide all 
students, including those who read, write, 
speak or listen below grade level, with 
extensive opportunities to work with and 
meet grade level Standards? 


Examine the tasks and instructions in the 
sample chapters from throughout and 
across grades. Prefatory materials might 
also help you determine publisher attention 
to supporting all students. 
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Alignment Criterion 7 

Access to the Standards for All Students 


Metric 


How to Find the Evidence 


AC Metric 7B: 

Do materials regularly include extensions 
and/or more advanced opportunities for 
students who read, write, speak or listen 
above grade level? 


Examine the tasks and instructions in the 
sample chapters from throughout and 
across grades. Prefatory materials might 
also help you determine publisher attention 
to supporting all students. 
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Alignment Criterion 7 

Access to the Standards for All Students 


Metric 


AC Metric 7C: 

Are there suggestions and materials for 
adapting instruction for varying student 
needs (e.g., alternative teaching approaches, 
pacing, instructional delivery options, 
suggestions for addressing common student 
difficulties, remediation strategies)? 


How to Find the Evidence 


Examine the support materials and teacher 
instructions in sample lessons. Guidance 
should be practical and straightforward 
to implement. All recommended supports 
should be contained in the submission and 
readily available. 
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Alignment Criterion 7 

Access to the Standards for All Students 


Metric 

How to Find the Evidence 

AC Metric 7D: 

Do materials regularly and systematically 
build in the time and resources required to 
allow teachers to guide all students to meet 
grade level Standards? 

Evaluate teacher instructions in sample 
lessons to determine how systematically the 
materials provide these opportunities and 
guidance. 
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Alignment Criterion 7 

Access to the Standards for All Students 


Metric 


AC Metric 7E: 

Do the materials regularly and systematically 
offer assessment opportunities that 
genuinely measure progress? Does 
this progress include gradual release of 
supporting scaffolds for students to measure 
their independent abilities? 


How to Find the Evidence 


Examine table of contents to see how 
assessment of student progress is handled. 
If there are supplemental materials that 
provide assessment, evaluate how closely 
linked they are to lessons and instruction in 
at least 5 samplings from across the year. 
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Alignment Criterion 7 

Access to the Standards for All Students 

SECTION 2 

Instructional Materials Evaluation Toolkit (IMET) 

ELA/Literacy, Grades K-2 


Alignment Criterion 7: Materials must provide thoughtful supports/scaffolds to support all students in 
accessing the CCSS. 


Points Assigned for Alignment Criterion 7 

Rating 

Materials must earn at least 8 out of 10 points to meet Alignment Criterion 7. If materials earn less than 8 points, the Criterion 
has not been met. Check the final rating. 

Total (10 points possible) 

Then, briefly describe the strengths and weaknesses of these materials in light of this Criterion. 

] Meets 
] Does Not Meet 


Strengths / Weaknesses: 


Move to the Evaluation Summary on the following page to record the final Meets or Does Not Meet rating. 
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SECTION 2 

Instructional Materials Evaluation Toolkit (IMET) 

ELA/Literacy, Grades K-2 


Title of Submission: Name of Evaluator(s): 

Publisher: Date of Evaluation: 

Date of Publication: Signature of Each Evaluator(s): 


Non-Negotiable Criteria 

Alignment Criteria 



Each Non-Negotiable must be met in order 

Each Alignment Criterion must be met with a sufficient number of points in order for Alignment Criteria to be labeled as “Meets” overall. The more 

for the Non-Negotiable Alignment Criteria to 

points the materials receive on the Alignment Criteria, the better they are aligned. 


be met overall. 

Alignment Criterion 1: 

Alignment Criterion 2: 

Alignment Criterion 3: 

Non-Negotiable 1: 

Range and Quality of Texts 

Questions and Tasks 

Writing to Sources and Research 

Complexity of Texts 

Points: of 10 possible. 

Points: of 6 possible. 

Points: of 8 possible. 

] Meets 

(Materials must receive at least 7 of 10 points 

(Materials must receive at least 4 of 6 points 

(Materials must receive at least 6 of 8 points 

to align.) 

to align.) 

to align.) 

] Does Not Meet 

] Meets Q N/A 

] Meets Q N/A 

] Meets Q N/A 


] Does Not Meet 

] Does Not Meet 

] Does Not Meet 

Non-Negotiable 2: 



Text Dependence and Specific Questions 

Alignment Criterion 4: 

Alignment Criterion 5: 

Alignment Criterion 6: 

] Meets 
] Does Not Meet 

Foundational Skills 

Language 

Speaking and Listening 

Points: of 8 possible. 

Points: of 6 possible. 

Points: of 10 possible. 

(Materials must receive at least 6 of 8 points 

(Materials must receive at least 4 of 6 points 

(Materials must receive at least 7 of 10 points 


to align.) 

to align.) 

to align.) 


] Meets Q N/A 

] Meets Q N/A 

] Meets Q N/A 


] Does Not Meet 

] Does Not Meet 

] Does Not Meet 

Non-Negotiables Overall 

Alignment Criteria Overall 


Alignment Criterion 7: 

Access to the Standards for All Students 

] Meets 

] Meets 


Points: of 1 0 possible. 

] Does Not Meet 

] Does Not Meet 


(Materials must receive at least 8 of 1 0 points 
to align.) 


□ Meets Q N/A 

] Does Not Meet 
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IMET Evaluation Summary 2 of 2 


SECTION 2 

Instructional Materials Evaluation Toolkit (IMET) 

ELA/Literacy, Grades K-2 


Title of Submission: 

Publisher: 

Date of Publication: 


Name of Evaluator(s): 

Date of Evaluation: 

Signature of Each Evaluator(s): 


Summary 

If the materials meet both Non-Negotiables and relevant Alignment Criteria, they are aligned to 
the Shifts and major features of the CCSS. 

Do the materials meet the Non-Negotiables and relevant Alignment Criteria? 

Yes 
No 


What are the specific areas of strength and weakness based on this review? 

Publishers or others modifying or developing assessments can use this information to make 
improvements and/or to remedy gaps in the alignment of assessment materials. 
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Indicators of Quality 


SECTION 2 

Instructional Materials Evaluation Toolkit (IMET) 

ELA/Literacy, Grades K-2 


Once an evaluation for alignment to the Shifts and major features of the CCSS has been conducted using Sections 1 - 3, it’s important to evaluate for 
overall quality and best practices. A starting list of Indicators of Quality is suggested below. States, districts and others evaluating instructional materials 
are encouraged to add to this list to ensure materials reflect local contexts. 


Indicators: Usefulness, Design, Focus Evidence 


Rating (Y/N) 


1 . Do the student resources include ample easily 
implemented review and practice resources, clear 
directions and explanations, and correct labeling of 
reference aids (e.g., visuals, maps, etc.)? 

2. Are the materials easy to use? Are they clearly laid out for 
students and teachers? Does every page of the 
submission add to student learning rather than distract 
from it? Are reading selections centrally located within the 
materials and obviously the center of focus? 

3. Can the teacher and student reasonably complete the 
content presented within a regular school year and 
does the pacing of content allow for maximum student 
understanding? Do the materials provide clear guidance 
to teachers about the amount of time the lesson might 
reasonably take? 

4. Do instructions allow for careful reading and rereading 
of content? 


5. Do the materials contain clear statements and explanation 
of purpose, goals, and expected outcomes? 
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Instructional Materials Evaluation Tool 

ELA/Literacy, Grades 3-12 


What Are the Purposes of the IMET ? 

This ELA/Literacy IMET is designed to help educators determine whether 
instructional materials are aligned to the Shifts and major features of the 
Common Core State Standards (CCSS). The substantial instructional Shifts 
(http://www.corestandards.org/other-resources/key-shifts-in-english-language- 
arts/) at the heart of the Common Core State Standards are: 

• Complexity: Regular practice with complex text and its 
academic language 

• Evidence: Reading, writing, and speaking grounded in evidence 
from text, both literary and informational 

• Knowledge: Building knowledge through content-rich 
non-fiction. 

The IMET draws directly from the following documents: 

• Common Core State Standards for English Language Arts & Literacy 

in History/Social Studies, Science, and Technical Subjects (http://www. 
corestandards.org/ELA-Literacy/) 

• Publishers’ Criteria for the Common Core State Standards in ELA/literacy 
grades 3-12 (http://corestandards.org/assets/Publishers_ 

Criteria_for_3-1 2.pd1) 

• Supplement to Appendix A of the Common Core State Standards for 
ELA/Literacy: New Research on Text Complexity 
(http://www.corestandards.org/assets/E0813_Appendix_A_New_ 
Research_on_Text_Complexity. pdf 

When to use the IMET 


consider. This tool is designed to evaluate alignment of 
instructional materials to the Shifts and the major features of 
the CCSS. It also provides suggestions of additional indicators 
to consider in the materials evaluation and purchasing process. 

2. Evaluating materials currently in use: The IMET can be used 
to analyze the degree of alignment of existing materials and 
help to highlight specific, concrete flaws in alignment. Even 
where materials and tools currently in use fail to meet one 
or more of these criteria, the pattern of failure is likely to be 
informative. States and districts can use the evaluation to create 
a thoughtful plan to modify or combine existing resources in 
such a way that students’ actual learning experiences approach 
the complexity, evidence, and knowledge building of the 
Standards. 

3. Developing materials: Those developing new materials locally 
can use this tool as guidance for creating aligned ELA/Literacy 
curricula. 

Please note this tool was designed to evaluate comprehensive curricula 
(including any supplemental or ancillary materials), but it was not 
designed for the evaluation of standalone supplemental materials. 

Who Uses the IMET? 

Evaluating instructional materials requires both subject-matter 
and pedagogical expertise. Evaluators should be well versed in 
the Standards (http://www.corestandards.org/ELA-Literacy/) for 
all grades in which materials are being evaluated. Evaluators also 
should be familiar with the substantial instructional Shifts (http://www. 
corestandards.org/other-resources/key-shifts-in-english-language- 
arts/) of Complexity, Evidence, and Knowledge that are listed above. 


1 . Purchasing materials: Many factors go into local purchasing 
decisions. Alignment to the Standards is a critical factor to 
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Getting Started 

Prior to Evaluation 

Assemble all of the materials necessary for the evaluation. In addition, 
each evaluator should have a reference copy of the Common Core 
State Standards for ELA/Literacy and the Publishers’ Criteria for the 
Common Core State Standards in ELA/Literacy grades 3-12. 

Before conducting the evaluation itself, it is important to develop 
a protocol for the evaluation process. The protocol should include 
having evaluators study the Publishers’ Criteria and the IMET. It will 
also be helpful for evaluators to get a sense of each program overall 
before beginning the process. 

Sections 1-3 below should be completed to produce a comprehensive 
picture of the strengths and weaknesses of the materials under 
evaluation. Information about areas in need of improvement or 
supplementation should be shared with internal and external 
stakeholders. 

Navigating the Tool 

Begin with Section 1: Non-Negotiable Alignment Criteria (p. 64) 

• The Non-Negotiable Alignment Criteria must each be met in 
full for materials to be considered aligned to the Shifts and 
the major features of the Common Core State Standards. Each 
Non-Negotiable Alignment Criterion has one or more metrics 
associated with it; every one of these metrics must be met in 
order for the criterion as a whole to be met. 

• Examine the relevant materials and use evidence to rate the 
materials against each criterion and its associated metrics. 

• Record and explain the evidence upon which the rating 
is based. 


Continue to Section 2: Alignment Criteria (p. 72) 

• The Alignment Criteria must each be met for materials to be 
considered aligned to the Shifts and the major features of the 
Common Core State Standards. Each Alignment Criterion has 
one or more metric associated with it; a specific number of 
these metrics must be met or partially met in order for the 
criterion as a whole to be met. 

• Examine the materials in relation to these criteria, assigning each 
metric a point value. Rate each criterion as “Meets” or “Does 
Not Meet” based on the number of points assigned. The more 
points the materials receive on the Alignment Criteria, the better 
they are aligned. 

• Record and explain the evidence upon which the rating 
is based. 

Complete Section 3: Evaluation Summary (p. 115) 

• Compile all of the results from Sections 1 and 2 to determine 

if the instructional materials are aligned to the Shifts and major 
features of the CCSS. 

Proceed to Section 4: Indicators of Quality (p. 117) 

• Indicators of Quality are important considerations that will help 
evaluators better understand the overall quality of instructional 
materials. These considerations are not for alignment to the 
CCSS, but they provide valuable information about additional 
curricula characteristics. Evaluators may want to add their own 
indicators to the examples provided. 
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Directions for Non-Negotiable 1 

Complexity of Texts 

Non-Negotiable 1 : ELA/literacy texts have the appropriate level of complexity for the grade, according 
to both quantitative measures and qualitative analysis of text complexity — texts are worthy of student 
time and attention. 

3. When the section is finished, if any one of the metrics is rated 
as Does Not Meet, then rate the overall Non-Negotiable 1 as 
Does Not Meet. If all metrics are rated as Meets, then rate the 
overall Non-Negotiable 1 as Meets. 

• Appendix A pages 1 -1 0 for more on the vital role text complexity 
plays in the CCSS (http://www.corestandards.org/assets/ 

Appendix_A.pdf) 

• Supplement to Appendix A: New Research on Text Complexity 
(http://www.corestandards.org/assets/E0813_Appendix_A_ 

New_Research_on_Text_Complexity.pdf) 


Required Materials 

• Teacher’s edition and student materials 


SECTION 2 

Instructional Materials Evaluation Toolkit (IMET) 

ELA/Literacy, Grades 3-12 


Rating this Criterion 

Non-Negotiable Alignment Criteria are defined as the set of criteria 
that must be met in full for materials to be considered aligned to the 
Shifts and the major features of the Common Core State Standards. 
Each metric of a Non-Negotiable Alignment Criterion must be met in 
order for the criterion to be met. 

1 . Evaluate carefully how completely the submission meets each 
of the metrics for this Criterion below. 

2. Provide specific examples of evidence in support of the rating, 
including pointing out specific gaps in the materials. 
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Non-Negotiable 1 

Complexity of Texts 


Metric 


NN Metric 1A: 

1 00% of texts must be accompanied by 
specific evidence that they have been 
analyzed with at least one research-based 
quantitative measure for grade band 
placement. 
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SECTION 2 

Instructional Materials Evaluation Toolkit (IMET) 

ELA/Literacy, Grades 3-12 


How to Find the Evidence Evidence 


Look for a publisher-supplied list of all texts 
in the submission with their quantitative 
measures. 

District conducts evaluation of all texts in the 
submission. 

Other evidence that texts have been 
measured by a quantitative measure. 


Rating 


□ 

□ 


Meets 

Does Not Meet / Insufficient Evidence 
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Non-Negotiable 1 

Complexity of Texts 


Metric 


NN Metric IB: 

100% of texts must be accompanied by 
specific evidence that they have been 
analyzed for their qualitative features 
indicating a specific grade level placement. 
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How to Find the Evidence Evidence 


Look for a publisher-supplied list of all texts 
in the submission with their qualitative 
measures. 

District conducts evaluation of ail texts in the 
submission. 

Look for other evidence that texts have been 
qualitatively analyzed. 


Rating 


□ 

□ 


Meets 

Does Not Meet / Insufficient Evidence 
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Non-Negotiable 1 

Complexity of Texts 


SECTION 2 

Instructional Materials Evaluation Toolkit (IMET) 

ELA/Literacy, Grades 3-12 


Non-Negotiable 1: Texts are worthy of student time and attention; they have the appropriate level of 
complexity for the grade, according to both quantitative and qualitative analyses of text complexity. 


Rating for Non-Negotiable 1 


Rating 


If both metrics were rated as Meets, then rate Non-Negotiable 1 as Meets. If one or more metrics were rated as Does Not Meet, 
then rate Non-Negotiable 1 as Does Not Meet. Check the final rating. 

Then, briefly describe the strengths and weaknesses of these materials in light of this Criterion. 


□ Meets 

□ Does Not Meet 


Strengths / Weaknesses: 


Before moving to Non-Negotiable 2, record the final Meets or Does Not Meet rating in the Evaluation Summary on Page 115. 


Published v.2 201 4 - send feedback to info@studentsachieve.net Reviewer Initials: 


Title of Program: 


67 


Directions for Non-Negotiable 2 

Text-Dependent and Text-Specific Questions 

Non-Negotiable 2: At least 80% of all questions in the submission are high-quality text-dependent 
and text-specific questions. The overwhelming majority of these questions are text-specific and draw 
student attention to the text. 

3. When the section is finished, if any one of the metrics is rated 
as Does Not Meet, then rate the overall Non-Negotiable 2 as 
Does Not Meet. If all metrics are rated as Meets, then rate the 
overall Non-Negotiable 2 as Meets. 

• Appropriate grade level set of ELA/Literacy Standards 

• Tools for evaluating the quality of text dependent questions 
(http://achievethecore.org/page/71 0/text-dependent-question- 
resources) 


Required Materials 

• Teacher’s edition and student materials 


SECTION 2 

Instructional Materials Evaluation Toolkit (IMET) 

ELA/Literacy, Grades 3-12 


Rating this Criterion 

Non-Negotiable Alignment Criteria are defined as the set of criteria 
that must be met in full for materials to be considered aligned to the 
Shifts and the major features of the Common Core State Standards. 
Each metric of a Non-Negotiable Alignment Criterion must be met in 
order for the criterion to be met. 

1 . Evaluate carefully how completely the submission meets each 
of the metrics for this Criterion below. 

2. Provide specific examples of evidence in support of the rating, 
including pointing out specific gaps in the materials. 
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Non-Negotiable 2 

Text-Dependent and Text-Specific Questions 


Metric 


NN Metric 2A: 

At least eighty percent of all questions and 
tasks should be text dependent to reflect 
the requirements of Reading Standard 1 (by 
requiring use of textual evidence to support 
valid inferences from the text). 


How to Find the Evidence 


Analyze a large* sample set of questions 
from across the submission, including 
culminating tasks and extended response 
tasks, and evaluate them for text 
dependency/text specificity and requiring 
readers to produce evidence. 

'Recommendation: analyze one in every four 
sets of questions and tasks completely to 
get a valid sample size. 


Published v.2 2014 - send feedback to info@studentsachieve.net 


Reviewer Initials: 


SECTION 2 

Instructional Materials Evaluation Toolkit (IMET) 

ELA/Literacy, Grades 3-1 2 


Evidence 


Rating 


□ 

□ 


Meets 

Does Not Meet / Insufficient Evidence 
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Non-Negotiable 2 

Text-Dependent and Text-Specific Questions 


Metric 


NN Metric 2B: 

Questions and tasks accurately address the 
analytical thinking required by the Standards 
at each grade level. NOTE: while multiple 
Standards will be addressed with every text, 
not every standard must be addressed with 
every text. 


How to Find the Evidence 


Look for publisher-produced alignment 
documentation of the Standards addressed 
by specific questions and tasks. 

Analyze the same large* sample set of 
questions from across the submission, 
including culminating tasks and extended 
response tasks, and evaluate which 
Standard(s) each meets. 

'Recommendation: analyze one in every four 
sets of questions and tasks completely to 
get a valid sample size. 
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Evidence 


Rating 


□ 

□ 


Meets 

Does Not Meet / Insufficient Evidence 
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SECTION 2 

Instructional Materials Evaluation Toolkit (IMET) 

ELA/Literacy, Grades 3-12 

Non-Negotiable 2: At least 80% of all questions in the submission are high-quality text-dependent 
and text-specific questions. The overwhelming majority of these questions are text-specific and draw 
student attention to the text. 


Non-Negotiable 2 

Text-Dependent and Text-Specific Questions 


Rating for Non-Negotiable 2 


Rating 


If both metrics were rated as Meets, then rate Non-Negotiable 2 as Meets. If one or more metrics were rated as Does Not Meet, 
then rate Non-Negotiable 2 as Does Not Meet. Check the final rating. 

Then, briefly describe the strengths and weaknesses of these materials in light of this Criterion. 


] Meets 

□ Does Not Meet 


Strengths / Weaknesses: 


Before moving to Alignment Criterion 1, record the final Meets or Does Not Meet rating in the Evaluation Summary on Page 115. 


Now continue by evaluating the Alignment Criterion 1 for Range and Quality of Texts 
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Directions for Alignment Criterion 1 

Range and Quality of Texts 

Alignment Criterion 1: Materials reflect the distribution of text types and genres required by the Standards. 


SECTION 2 

Instructional Materials Evaluation Toolkit (IMET) 

ELA/Literacy, Grades 3-12 


Required Materials 


• Teacher’s edition and student materials 

• Appropriate grade level set of ELA/Literacy Standards 


Rating this Criterion 

1 . Rate how well the submission meets each of the criteria below. 
Ratings are Meets (2 points), Partially Meets (1 point), or Does 
Not Meet (0 points). 

2. Provide specific examples of evidence in support of the rating, 
including pointing out specific gaps in the materials. 

3. When the section is finished, add up the rating and enter it at 
the bottom of the section. A rating of 7 out of 10 points means 
that the materials have met this Alignment Criterion. 

4. Lastly, record the rating Meets, Does Not Meet or Not 
Applicable for this section in the Evaluation Summary on page 
115 before proceeding to Alignment Criterion 2. The more 
points the materials receive on the Alignment Criteria, the better 
they are aligned. 
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Alignment Criterion 1 

Range and Quality of Texts 


Metric 


AC Metric 1A: 

Materials pay careful attention to providing 
a sequence or collection of texts that build 
knowledge systematically through reading, 
writing, listening, and speaking about topics 
under study. 


How to Find the Evidence 


Examine the table of contents at each grade 
level to see if the collection is carefully 
sequenced and organized with the aim of 
increasing knowledge on several topics of 
focused inquiry. 

Other evidence as appropriate. 
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Rating 


] Meets (2) 
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Alignment Criterion 1 

Range and Quality of Texts 


Metric 

How to Find the Evidence 

AC Metric IB: 

Within a sequence or collection of texts, 
specific anchor texts of grade-level 
complexity (keystone texts) are selected for 
their quality as being worthy of especially 
careful reading. 

Evaluate sample lessons to ensure they call 
for careful reading through the instructions 
offered to teachers and students. 
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Rating 
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Alignment Criterion 1 

Range and Quality of Texts 


Metric 


How to Find the Evidence 


AC Metric 1C: 

In grades 3-5, literacy programs shift the 
balance of texts and instructional time to 
50% literature / 50% informational high- 
quality text. In grades 6-12 ELA materials 
include substantial attention to high quality 
nonfiction. 


Look for a list of all the texts selected for 
submission with this information clearly 
provided and summarized. 
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Alignment Criterion 1 

Range and Quality of Texts 


Metric 


How to Find the Evidence 


AC Metric 1 D: Look for a list of all the texts selected for 

A large majority of texts included in submission with this information provided. 

instructional materials reflect the text 

characteristics and genres that are 

specifically required by the Standards at 

each grade level. 
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Evidence 


Rating 


□ Meets (2) 

□ Partially Meets (1) 
] Does Not Meet (0) 
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Alignment Criterion 1 

Range and Quality of Texts 


SECTION 2 

Instructional Materials Evaluation Toolkit (IMET) 

ELA/Literacy, Grades 3-12 


Metric 


How to Find the Evidence Evidence 


AC Metric 1 E: Examine a representative sample of texts or 

Additional materials markedly increase the the description of the supplemental materials 

opportunity for regular independent reading to evaluate. 

of texts that appeal to students’ interests 

to develop both knowledge and love of 

reading. 


Rating 


] Meets (2) 

] Partially Meets (1) 
I I Does Not Meet (0) 
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Alignment Criterion 1 

Range and Quality of Texts 

SECTION 2 

Instructional Materials Evaluation Toolkit (IMET) 

ELA/Literacy, Grades 3-12 


Alignment Criterion 1: Materials reflect the distribution of text types and genres required by the 
Standards. 


Points Assigned for Alignment Criterion 1 

Rating 

Materials must earn at least 7 out of 10 points to meet Alignment Criterion 1 . If materials earn less than 7 points, the Criterion 
has not been met. Check the final rating. 

Total (10 points possible) 

Then, briefly describe the strengths and weaknesses of these materials in light of this Criterion. 

] Meets 
] Does Not Meet 


Strengths / Weaknesses: 


Before moving to Alignment Criterion 2, record the final Meets or Does Not Meet rating in the Evaluation Summary on Page 115. 
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Directions for Alignment Criterion 2 

Questions and Tasks 

Alignment Criterion 2: They support students in building reading comprehension, in finding and producing 
the textual evidence to support their responses, and in developing grade level academic language. 


SECTION 2 

Instructional Materials Evaluation Toolkit (IMET) 

ELA/Literacy, Grades 3-12 


4. Lastly, record the rating Meets, Does Not Meet or Not 
Applicable for this section in the Evaluation Summary on page 
115 before proceeding to Alignment Criterion 3. The more 
points the materials receive on the Alignment Criteria, the better 
they are aligned. 

• Tools for evaluating the quality of text dependent questions 
(http://achievethecore.org/page/71 0/text-dependent-question- 
resources) 


Required Materials 

• Teacher’s edition and student materials 

• Appropriate grade level set of ELA/Literacy Standards 


Rating this Criterion 

1 . Rate how well the submission meets each of the Criteria below. 
Ratings are Meets (2 points), Partially Meets (1 point), or Does 
Not Meet (0 points). 

2. Provide specific examples of evidence in support of the rating, 
including pointing out specific gaps in the materials. 

3. When the section is finished, add up the rating and enter it at 
the bottom of the section. A rating of 4 out of 6 points means 
that the materials have met this Alignment Criterion. 
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Alignment Criterion 2 

Questions and Tasks 


Metric 


AC Metric 2A: 

High-quality sequences of text -dependent 
questions are prevalent and can address 
any of the following: sustained attention to 
making meaning from the text, rereading to 
gain evidence and clarity, and the acquisition 
of foundational skills. 


How to Find the Evidence 


Analyze a large* sample of questions 
from different grade levels/sections of the 
program. 

‘Recommendation: analyze one in every four 
sets of questions and tasks completely to 
get a valid sample size. 
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Rating 


] Meets (2) 
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Alignment Criterion 2 

Questions and Tasks 


Metric 


How to Find the Evidence 


AC Metric 2B: 

Questions and tasks support students 
in unpacking the academic language 
(vocabulary and syntax) prevalent in 
complex texts. 


Analyze a large* sample of questions 
and tasks to see that there are regularly 
questions asking students to address the 
meaning of academic vocabulary and to 
unpack complex sentences. 

‘Recommendation: analyze one in every four 
sets of questions and tasks completely to 
get a valid sample size. 
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Evidence 


Rating 


□ Meets (2) 

□ Partially Meets (1) 

□ Does Not Meet (0) 
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Alignment Criterion 2 

Questions and Tasks 


Metric 


How to Find the Evidence 


AC Metric 2C: 

Questions build to a deep understanding of 
the central ideas of the text. 


Analyze a large sample* of questions and 
tasks to see they address the central ideas 
of the text. Take particular note to see if 
they support students’ ability to address the 
culminating task. 

‘Recommendation: analyze one in every four 
sets of questions and tasks completely to 
get a valid sample size. 
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Evidence 


Rating 


□ Meets (2) 

] Partially Meets (1) 

□ Does Not Meet (0) 
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Alignment Criterion 2 

Questions and Tasks 

SECTION 2 

Instructional Materials Evaluation Toolkit (IMET) 

ELA/Literacy, Grades 3-12 


Alignment Criterion 2: They support students in building reading comprehension, in finding and producing 
the textual evidence to support their responses, and in developing grade level academic language. 


Points Assigned for Alignment Criterion 2 

Rating 

Materials must earn at least 4 out of 6 points to meet Alignment Criterion 2. If materials earn less than 4 points, the Criterion has 
not been met. Check the final rating. 

Total (6 points possible) 

Then, briefly describe the strengths and weaknesses of these materials in light of this Criterion. 

] Meets 
] Does Not Meet 


Strengths / Weaknesses: 


Before moving to Alignment Criterion 3, record the final Meets or Does Not Meet rating in the Evaluation Summary on Page 115. 
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Directions for Alignment Criterion 3 

Writing to Sources and Research 

Alignment Criterion 3: Written and oral tasks at all grade levels require students to confront the text 
directly, to draw on textual evidence, and to support valid inferences from the text. 

Required Materials 

• Teacher’s edition and student materials 

• Appropriate grade level set of ELA/Literacy Standards 


SECTION 2 

Instructional Materials Evaluation Toolkit (IMET) 

ELA/Literacy, Grades 3-12 


Rating this Criterion 

1 . Rate how well the submission meets each of the Criteria below. 
Ratings are Meets (2 points), Partially Meets (1 point), or Does 
Not Meet (0 points). 

2. Provide specific examples of evidence in support of the rating, 
including pointing out specific gaps in the materials. 

3. When the section is finished, add up the rating and enter it at 
the bottom of the section. A rating of 6 out of 8 points means 
that the materials have met this Alignment Criterion. 

4. Lastly, record the rating Meets, Does Not Meet or Not 
Applicable for this section in the Evaluation on page 1 1 5 before 
Proceeding to Alignment Criterion 4. The more points the 
materials receive on the Alignment Criteria, the better they are 
aligned. 
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Alignment Criterion 3 

Writing to Sources and Research 


Metric 


How to Find the Evidence 


AC Metric 3A: 

Writing to sources is a key task. Students 
are asked in their writing to analyze and 
synthesize sources, as well as to present 
careful analysis, well-defended claims, and 
clear information. 


Examine a sampling (minimum 8 per grade) 
of the writing tasks for each section, listing 
any tasks or items that do not require writing 
to sources. Calculate a percentage of 
aligned tasks. For alignment, three-quarters 
of tasks should require writing to sources. 
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Alignment Criterion 3 

Writing to Sources and Research 


Metric 


How to Find the Evidence 


AC Metric 3B: 

Materials place an increased focus on 
argument and informative writing in the 
following proportions. Alternately, they may 
reflect blended forms in similar proportions 
(e.g. exposition and persuasion): 


Examine the table of contents to see if they 
match up with this distribution. When the 
title does not clearly indicate what type of 
writing look at the assignment itself. 


Grades 3-5 exposition 35% 

persuasion 30% 
narrative 35% 

Grades 6-8 exposition 35% 

argument 35% 
narrative 30% 


High School exposition 40% 
argument 40% 
narrative 20% 
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Rating 


] Meets (2) 

] Partially Meets (1) 
] Does Not Meet (0) 
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Alignment Criterion 3 

Writing to Sources and Research 


Metric 


How to Find the Evidence 


AC Metric 3C: Examine the table of contents to see this is 

Writing opportunities for students are the case, 

prominent and varied. 

Alternately, examine the Index to see if the 
terms narrative, informative/expository, 
and narrative appear in the appropriate 
percentages as the grade level would 
require. 
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Evidence 


Rating 


□ Meets (2) 

□ Partially Meets (1) 

□ Does Not Meet (0) 
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Alignment Criterion 3 

Writing to Sources and Research 


Metric 


How to Find the Evidence 


AC Metric 3D: 

Extensive practice with short, focused 
research projects is provided. Materials 
require students to engage in many short 
research projects annually to enable 
students to develop the expertise needed to 
conduct research independently. 


Examine the table of contents to see the 
frequency of these assignments. 

Alternately, examine the Index to see the 
frequency of “research” as a term. 

Spot check % of those page references to 
gauge frequency and quality of instructional 
guidance. 

Read the instructions to see they are in fact 
short.* 

‘Short research projects would be no more 
than a week. 
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Evidence 


Rating 


□ Meets (2) 

] Partially Meets (1) 
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Alignment Criterion 3 

Writing to Sources and Research 


SECTION 2 

Instructional Materials Evaluation Toolkit (IMET) 

ELA/Literacy, Grades 3-12 


Alignment Criterion 3: Written and oral tasks at all grade levels require students to confront the text 
directly, to draw on textual evidence, and to support valid inferences from the text. 


Points Assigned for Alignment Criterion 3 

Rating 

Materials must earn at least 6 out of 8 points to meet Alignment Criterion 3. If materials earn less than 6 points, the Criterion has 
not been met. Check the final rating. 

Total (8 points possible) 

Then, briefly describe the strengths and weaknesses of these materials in light of this Criterion. 

] Meets 
] Does Not Meet 


Strengths / Weaknesses: 


Before moving to Alignment Criterion 4, record the final Meets or Does Not Meet rating in the Evaluation Summary on Page 115. 
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Directions for Alignment Criterion 4 

Foundational Skills 

Alignment Criterion 4: Materials provide explicit and systematic instruction and diagnostic support in 
phonics, vocabulary, development, syntax, and fluency. These foundational skills are necessary and 
central components of an effective, comprehensive reading program designed to develop proficient 
readers with the capacity to comprehend texts across a range of types and disciplines. 


SECTION 2 

Instructional Materials Evaluation Toolkit (IMET) 

ELA/Literacy, Grades 3-12 


4. Lastly, record the rating Meets, Does Not Meet or Not 
Applicable for this section in the summary sheet on page 1 1 5 
before going on. The more points the materials receive on the 
Alignment Criteria, the better they are aligned. 

• Teacher’s edition and student materials 

• Refer to the to the grade-level specific Reading Standards for 
Foundations Skills (http://www.corestandards.org/ELA-Literacy/ 

RF/introduction/) 


This Criterion should be used for Grades 3-5 submissions only. 

Required Materials 


Rating this Criterion 

1 . Rate how well the submission meets each of the Criteria below. 
Ratings are Meets (2 points), Partially Meets (1 point), or Does 
Not Meet (0 points). 

2. Provide specific examples of evidence in support of the rating, 
including pointing out specific gaps in the materials. 

3. When the section is finished, add up the rating and enter it at 
the bottom of the section. A rating of 6 out of 8 points means 
that the materials have met this Alignment Criterion. 
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Alignment Criterion 4 

Foundational Skills 


Metric 

How to Find the Evidence 

AC Metric 4A: 

Submissions address grade-level CCSS for 
foundational skills by providing instruction 
in phonics, word recognition, vocabulary, 
syntax, and reading fluency in a research- 
based and transparent progression. 

Examine the table of contents to see if this 
matches up with the foundational Standards 
for each of these grades. 
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Evidence 


Rating 


□ Meets (2) 
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I I Does Not Meet (0) 
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Alignment Criterion 4 

Foundational Skills 


Metric 

How to Find the Evidence 

AC Metric 4B: 

Materials guide students to read with 
purpose and understanding and to make 
frequent connections between acquisition of 
foundation skills and making meaning from 
reading. 

Examine instructions, questions and tasks in 
relevant foundational and other sections to 
see if this is called for. 
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Rating 


□ Meets (2) 
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□ Does Not Meet (0) 
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Alignment Criterion 4 

Foundational Skills 


Metric 


How to Find the Evidence 


AC Metric 4C: 

Opportunities are frequently built into the 
materials for students to achieve reading 
fluency in oral and silent reading, that is, 
to read on-level prose and poetry with 
accuracy, rate appropriate to the text, and 
expression. 


Examine the table of contents to see if this is 
addressed. Read the prefatory materials to 
see the rationale for how this is approached. 
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Rating 


] Meets (2) 

] Partially Meets (1) 
I I Does Not Meet (0) 
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Alignment Criterion 4 

Foundational Skills 


Metric 

How to Find the Evidence 

AC Metric 4D: 

Materials guide students to read grade-level 
text with purpose and understanding. 

Read instructions and prefatory material 
from throughout the submission to evaluate 
how well this is done. 
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] Meets (2) 
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SECTION 2 

Instructional Materials Evaluation Toolkit (IMET) 

ELA/Literacy, Grades 3-12 

Alignment Criterion 4: Materials provide explicit and systematic instruction and diagnostic support in 
phonics, vocabulary, development, syntax, and fluency. These foundational skills are necessary and 
central components of an effective, comprehensive reading program designed to develop proficient 
readers with the capacity to comprehend texts across a range of types and disciplines. 

Points Assigned for Alignment Criterion 4 Rating 


Materials must earn at least 6 out of 8 points to meet Alignment Criterion 4. If materials earn less than 6 points, the Criterion has Total (8 points possible) 

not been met. Check the final rating. 

Then, briefly describe the strengths and weaknesses of these materials in light of this Criterion. Q Meets 

] Does Not Meet 


Alignment Criterion 4 

Foundational Skills 


Strengths / Weaknesses: 


Before moving to Alignment Criterion 5, record the final Meets or Does Not Meet rating in the Evaluation Summary on Page 115. 
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Directions for Alignment Criterion 5 

Language 


SECTION 2 

Instructional Materials Evaluation Toolkit (IMET) 

ELA/Literacy, Grades 3-12 


Alignment Criteion 5: Materials adequately address the Language Standards for the grade. 


Required Materials 

• Teacher’s edition and student materials 

• Appropriate grade level set of Language Standards (http://www. 
corestandards.org/ELA-Literacy/Lyianguage-progressive-skills/) 


Rating this Criterion 

1 . Rate how well the submission meets each of the Criteria below. 
Ratings are Meets (2 points), Partially Meets (1 point), or Does 
Not Meet (0 points). 

2. Provide specific examples of evidence in support of the rating, 
including pointing out specific gaps in the materials. 

3. When the section is finished, add up the rating and enter it at 
the bottom of the section. A rating of 4 out of 6 points means 
that the materials have met this Alignment Criterion. 

4. Lastly, record the rating Meets, Does Not Meet or Not 
Applicable for this section in the summary sheet on page 1 1 5 
before going on. The more points the materials receive on the 
Alignment Criteria, the better they are aligned. 


Published v.2 201 4 - send feedback to info@studentsachieve.net Reviewer Initials: 


Title of Program: 


96 


Alignment Criterion 5 

Language 


Metric 


How to Find the Evidence 


AC Metric 5A: Examine the sections addressing this to see 

Materials address the grammar and if instructions include this, 

language conventions specified by the 
Language Standards at each grade level. 
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Rating 


□ Meets (2) 

] Partially Meets (1) 
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Alignment Criterion 5 

Language 


Metric 


AC Metric 5B: 

Materials expect students to confront their 
own error patterns in usage and conventions 
and correct them in a grade-by-grade 
pathway that results in college and career 
readiness by 12th grade. 


How to Find the Evidence 


Examine the table of contents to determine if 
these are included. 

Information might also be contained in 
prefatory materials. 
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Alignment Criterion 5 

Language 


SECTION 2 

Instructional Materials Evaluation Toolkit (IMET) 

ELA/Literacy, Grades 3-12 


Metric 


How to Find the Evidence Evidence 


AC Metric 5C: 

Materials provide a mirror of real-world 
activities for student practice with 
natural language (e.g. mock interviews, 
presentations). 


Examine the table of contents to determine if 
these are included. 

Information might also be contained in 
prefatory materials. 


Rating 


□ Meets (2) 

] Partially Meets (1) 
I I Does Not Meet (0) 
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Alignment Criterion 5 

Language 

SECTION 2 

Instructional Materials Evaluation Toolkit (IMET) 

ELA/Literacy, Grades 3-12 


Alignment Criterion 5: Materials adequately address the Language Standards for the grade. 


Points Assigned for Alignment Criterion 5 

Rating 

Materials must earn at least 4 out of 6 points to meet Alignment Criterion 5. If materials earn less than 4 points, the Criterion has 
not been met. Check the final rating. 

Total (6 points possible) 

Then, briefly describe the strengths and weaknesses of these materials in light of this Criterion. 

] Meets 
] Does Not Meet 


Strengths / Weaknesses: 


Before moving to Alignment Criterion 6, record the final Meets or Does Not Meet rating in the Evaluation Summary on Page 115. 
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Directions for Alignment Criterion 6 

Speaking and Listening 


SECTION 2 

Instructional Materials Evaluation Toolkit (IMET) 

ELA/Literacy, Grades 3-12 


Alignment Criterion 6: To be CCSS-aligned, speaking and listening are integrated into lessons, questions 
and tasks. These reflect a progression of communication skills required for college and career readiness as 
outlined in the Standards. 

Required Materials 


• Teacher’s edition and student materials 

• Appropriate grade level set of Speaking and Listening Standards 

(http://www.corestandards.org/ELA-Literacy/SLVintroduction/) 


Rating this Criterion 

1 . Rate how well the submission meets each of the Criteria below. 
Ratings are Meets (2 points), Partially Meets (1 point), or Does 
Not Meet (0 points). 

2. Provide specific examples of evidence in support of the rating, 
including pointing out specific gaps in the materials. 

3. When the section is finished, add up the rating and enter it at 
the bottom of the section. A rating of 7 out of 10 points means 
that the materials have met this Alignment Criterion. 

4. Lastly, record the rating Meets, Does Not Meet or Not 
Applicable for this section in the Evaluation Summary on page 
115 before proceeding to Alignment Criterion 7. The more 
points the materials receive on the Alignment Criteria, the better 
they are aligned. 
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Alignment Criterion 6 

Speaking and Listening 


Metric 


AC Metric 6A: 

Texts used in speaking and listening 
questions and tasks meet the criteria for 
complexity, range, and quality of texts (Non- 
Negotiable and Alignment Criterion 1). 


How to Find the Evidence 


Examine the tasks and instructions in 
the relevant sections. Prefatory materials 
might also help you determine if this is 
emphasized. 
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Evidence 


Rating 


□ Meets (2) 

] Partially Meets (1) 
I I Does Not Meet (0) 
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Alignment Criterion 6 

Speaking and Listening 


Metric 


AC Metric 6B: 

Materials demand that students engage 
effectively in a range of conversations and 
collaborations by expressing well-supported 
ideas clearly and building on others’ ideas. 


How to Find the Evidence 


Examine the tasks and instructions in 
the relevant sections. Prefatory materials 
might also help you determine if this is 
emphasized. 
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Alignment Criterion 6 

Speaking and Listening 


Metric 


AC Metric 6C: 

Materials develop active listening skills, such 
as taking notes on main ideas, asking relevant 
questions, and elaborating on remarks of 
others in a grade-appropriate way. 


How to Find the Evidence 


Examine the tasks and instructions in 
the relevant sections. Prefatory materials 
might also help you determine if this is 
emphasized. 
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Alignment Criterion 6 

Speaking and Listening 


Metric 


How to Find the Evidence 


AC Metric 6D: 

Materials require students to marshal 
evidence to orally present findings from 
research. 


Examine the sections devoted to research to 
see if this is explicitly called for. 

‘Research’ as a term should be listed in 
the Index. 
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Evidence 


Rating 


□ Meets (2) 
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□ Does Not Meet (0) 
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Alignment Criterion 6 

Speaking and Listening 


Metric 


How to Find the Evidence 


AC Metric 6E: Examine instructions and tasks in relevant 

Materials build in frequent opportunities sections to see if this is prevalent. 

for discussion and, through directions 

and modeling, encourage students to use 

academic language in their speech. 
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Alignment Criterion 6 

Speaking and Listening 


SECTION 2 

Instructional Materials Evaluation Toolkit (IMET) 

ELA/Literacy, Grades 3-12 


Alignment Criterion 6: To be CCSS-aligned, speaking and listening are integrated into lessons, questions 
and tasks. These reflect a progression of communication skills required for college and career readiness 
as outlined in the Standards. 


Points Assigned for Alignment Criterion 6 

Rating 

Materials must earn at least 7 out of 1 0 points to meet Alignment Criterion 6. If materials earn less than 7 points, the Criterion 
has not been met. Check the final rating. 

Total (10 points possible) 

Then, briefly describe the strengths and weaknesses of these materials in light of this Criterion. 

] Meets 
] Does Not Meet 


Strengths / Weaknesses: 


Before moving to Alignment Criterion 7, record the final Meets or Does Not Meet rating in the Evaluation Summary on Page 115. 
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Directions for Alignment Criterion 7 

Access to the Standards for All Students 


SECTION 2 

Instructional Materials Evaluation Toolkit (IMET) 

ELA/Literacy, Grades 3-12 


Alignment Criterion 7: Materials must provide thoughtful supports/scaffolds to support all students in 
accessing the CCSS. 


Because the Standards are for all students, alignment requires 
thoughtful support to ensure all students are able to meet the same 
Standards. Thus, materials must provide supports for English 
Language Learners and other special populations. 


Required Materials 

• Teacher’s edition and student materials 

• Appropriate grade level set of ELA/Literacy Standards 


3. When the section is finished, add up the rating and enter it at 
the bottom of the section. A rating of 8 out of 10 points means 
that the materials have met this Alignment Criterion. 

4. Lastly, record the rating Meets, Does Not Meet or Not 
Applicable for this section in the Evaluation Summary on page 
115 before proceeding further. The more points the materials 
receive on the Alignment Criteria, the better they are aligned. 


• If the submission has formative assessments and supplemental 
support materials as separate documents, gather them prior to 
evaluating this critical Alignment Criterion. 


Rating this Criterion 

1 . Rate how well the submission meets each of the Criteria below. 
Ratings are Meets (2 points), Partially Meets (1 point), or Does 
Not Meet (0 points). 

2. Provide specific examples of evidence in support of the rating, 
including pointing out specific gaps in the materials. 
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Alignment Criterion 7 

Access to the Standards for All Students 


Metric 


How to Find the Evidence 


AC Metric 7A: 

Do the materials regularly provide all 
students, including those who read, write, 
speak, or listen below grade level, with 
extensive opportunities to work with and 
meet grade level Standards? 


Examine the tasks and instructions in the 
sample chapters from throughout and 
across grades. Prefatory materials might 
also help you determine publisher attention 
to supporting all students. 
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Alignment Criterion 7 

Access to the Standards for All Students 


Metric 


How to Find the Evidence 


AC Metric 7B: 

Do materials regularly include extensions 
and/or more advanced opportunities for 
students who read, write, speak, or listen 
above grade level? 


Examine the tasks and instructions in the 
sample chapters from throughout and 
across grades. Prefatory materials might 
also help you determine publisher attention 
to supporting all students. 
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Alignment Criterion 7 

Access to the Standards for All Students 


Metric 


AC Metric 7C: 

Are there suggestions and materials for 
adapting instruction for varying student 
needs (e.g., alternative teaching approaches, 
pacing, instructional delivery options, 
suggestions for addressing common student 
difficulties, remediation strategies)? 


How to Find the Evidence 


Examine the support materials and teacher 
instructions in sample lessons. Guidance 
should be practical and straightforward 
to implement. All recommended supports 
should be contained in the submission and 
readily available. 
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Rating 
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Alignment Criterion 7 

Access to the Standards for All Students 


Metric 


AC Metric 7D: 

Do materials regularly and systematically 
build in the time and resources required to 
allow teachers to guide all students to meet 
grade level Standards? 


How to Find the Evidence 


Evaluate teacher instructions in sample 
lessons to determine how systematically the 
materials provide these opportunities 
and guidance. 
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Rating 
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Alignment Criterion 7 

Access to the Standards for All Students 


Metric 


AC Metric 7E: 

Do the materials regularly and systematically 
offer assessment opportunities that 
genuinely measure progress? Does 
this progress include gradual release of 
supporting scaffolds for students to measure 
their independent abilities? 


How to Find the Evidence 


Examine the table of contents to see how 
assessment of student progress is handled. 
If there are supplemental materials that 
provide assessment, evaluate how closely 
linked they are to lessons and instruction in 
at least 5 samplings from across the year. 
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Alignment Criterion 7 

Access to the Standards for All Students 

SECTION 2 

Instructional Materials Evaluation Toolkit (IMET) 

ELA/Literacy, Grades 3-12 


Alignment Criterion 7: Materials must provide thoughtful supports/scaffolds to support all students in 
accessing the CCSS. 


Points Assigned for Alignment Criterion 7 

Rating 

Materials must earn at least 8 out of 1 0 points to meet Alignment Criterion 7. If materials earn less than 8 points, the Criterion 
has not been met. Check the final rating. 

Total (10 points possible) 

Then, briefly describe the strengths and weaknesses of these materials in light of this Criterion. 

] Meets 
] Does Not Meet 


Strengths / Weaknesses: 


Move to the Evaluation Summary on the following page to record the final Meets or Does Not Meet rating. 
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SECTION 2 

Instructional Materials Evaluation Toolkit (IMET) 

ELA/Literacy, Grades 3-12 


Title of Submission: Name of Evaluatorfs): 

Publisher: Date of Evaluation: _ 


Date of Publication: Signature of Each Evaluator(s): 

Non-Negotiable Criteria Alignment Criteria 


Each Non-Negotiable must be met in order Each Alignment Criterion must be met with a sufficient number of points in order for Alignment Criteria to be labeled as “Meets” overall. The more 


for the Non-Negotiable Alignment Criteria to 

points the materials receive on the Alignment Criteria, the better they are aligned. 


be met overall. 

Alignment Criterion 1: 

Alignment Criterion 2: 

Alignment Criterion 3: 

Non-Negotiable 1: 

Range and Quality of Texts 

Questions and Tasks 

Writing to Sources and Research 

Complexity of Texts 

Points: of 10 possible. 

Points: of 6 possible. 

Points: of 8 possible. 

] Meets 

(Materials must receive at least 7 of 10 points 

(Materials must receive at least 4 of 6 points 

(Materials must receive at least 6 of 8 points 

to align.) 

to align.) 

to align.) 

] Does Not Meet 

] Meets Q N/A 

] Meets Q N/A 

] Meets Q N/A 


] Does Not Meet 

] Does Not Meet 

] Does Not Meet 

Non-Negotiable 2: 



Text Dependence and Specific Questions 

Alignment Criterion 4: 

Alignment Criterion 5: 

Alignment Criterion 6: 

] Meets 
] Does Not Meet 

Foundational Skills 

Language 

Speaking and Listening 

Points: of 8 possible. 

Points: of 6 possible. 

Points: of 10 possible. 

(Materials must receive at least 6 of 8 points 

(Materials must receive at least 4 of 6 points 

(Materials must receive at least 7 of 10 points 


to align.) 

to align.) 

to align.) 


] Meets Q N/A 

] Meets Q N/A 

] Meets Q N/A 


] Does Not Meet 

] Does Not Meet 

] Does Not Meet 

Non-Negotiables Overall 

Alignment Criteria Overall 


Alignment Criterion 7: 

Access to the Standards for All Students 

] Meets 

] Meets 


Points: of 1 0 possible. 

] Does Not Meet 

] Does Not Meet 


(Materials must receive at least 8 of 1 0 points 
to align.) 




] Meets Q N/A 

] Does Not Meet 
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SECTION 2 

Instructional Materials Evaluation Toolkit (IMET) 

ELA/Literacy, Grades 3-12 


Title of Submission: 

Publisher: 

Date of Publication: 


Name of Evaluator(s): 

Date of Evaluation: 

Signature of Each Evaluator(s): 


Summary 

If the materials meet both Non-Negotiables and relevant Alignment Criteria, they are aligned to 
the Shifts and major features of the CCSS. 

Do the materials meet both Non-Negotiables and the relevant Alignment Criteria? 

□ Yes 

□ No 


What are the specific areas of strength and weakness based on this evaluation? 

Publishers or others modifying or developing assessments can use this information to make 
improvements and/or to remedy gaps in the alignment of assessment materials. 
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Indicators of Superior Quality 


SECTION 2 

Instructional Materials Evaluation Toolkit (IMET) 

ELA/Literacy, Grades 3-12 


Once an evaluation for alignment to the Shifts and major features of the CCSS has been conducted using Sections 1-3, it’s important to evaluate 
for overall quality and best practices. A starting list of Indicators of Quality are suggested below. States, districts, and others evaluating instructional 
materials are encouraged to add to this list to ensure materials reflect local contexts. 


Indicators: Usefulness, Design, Focus Evidence 


Rating (Y/N) 


1 . Do the student resources include ample review and 
practice resources, clear directions and explanations, and 
correct labeling of reference aids (e.g., visuals, maps, etc.)? 

2. Are the materials easy to use? Are they clearly laid out for 
students and teachers? Does every page of the submission 
add to student learning rather than distract from it? Are 
reading selections centrally located within the materials 
and obviously the center of focus? 

3. Can the teacher and student reasonably complete the 
content presented within a regular school year and 
does the pacing of content allow for maximum student 
understanding? Do the materials provide clear guidance 
to teachers about the amount of time the lesson might 
reasonably take? 

4. Do instructions allow for careful reading and rereading 
of content? 

5. Do the materials contain clear statements and explanation 
of purpose, goals, and expected outcomes? 
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Instructional Materials Evaluation Tool 

Mathematics, Grades K-8 


What Are the Purposes of the IMET? 

This Math IMET is designed to help educators determine whether 
instructional materials are aligned to the Shifts and major features of the 
Common Core State Standards (CCSS). The substantial instructional 
Shifts (http://www.corestandards.org/other-resources/key-shifts-in- 
mathematics/) at the heart of the Common Core State Standards are: 

• Focus strongly where the Standards focus 

• Coherence: Think across grades and link to major topics within 
the grade 

• Rigor: In major topics, pursue conceptual understanding, 
procedural skill and fluency, and application with equal intensity. 

The IMET draws directly from the following documents: 

• Common Core State Standards for Mathematics 
(www.corestandards.org/Math) 

• Publishers’ Criteria for the Common Core State Standards in 
Mathematics grade K-8 

(http://www.corestandards.org/wp-content/uploads/Math_ 

Publishers_Criteria_K-8_Spring_2013_FINAL1.pdf) 

When to use the IMET 

1 . Purchasing materials: Many factors go into local purchasing 
decisions. Alignment to the Standards is a critical factor to 
consider. This tool is designed to evaluate alignment of 
instructional materials to the Shifts and the major features of 
the CCSS. It also provides suggestions of additional indicators 
to consider in the materials evaluation and purchasing process. 


2. Evaluating materials currently in use: The IMET can be used to 
analyze the degree of alignment of existing materials and help to 
highlight specific, concrete flaws in alignment. Even where 
materials and tools currently in use fail to meet one or more of 
these criteria, the pattern of failure is likely to be informative. 
States and districts can use the evaluation to create a thoughtful 
plan to modify or combine existing resources in such a way that 
students’ actual learning experiences approach the focus, 
coherence, and rigor of the Standards. 

3. Developing programs: Those developing new programs can use 
this tool as guidance for creating aligned curricula. 

Please note this tool was designed for evaluating comprehensive 
curricula (including any supplemental or ancillary materials), but it was 
not designed for the evaluation of standalone supplemental materials. 

Who Uses the IMET? 

Evaluating instructional materials requires both subject-matter and 
pedagogical expertise. Evaluators should be well versed in the 
Standards (www.corestandards.org/Math) for all grades in which 
materials are being evaluated. This includes understanding the Major 
Work of the grade (www.achievethecore/focus), the Supporting 
and Additional work, how the content fits into the progressions 
in the Standards (www.achievethecore.org/progressions), and 
the expectations of the Standards with respect to conceptual 
understanding, procedural skill and fluency, and application. Evaluators 
also should be familiar with the substantial instructional Shifts (http:// 
www.corestandards.org/other-resources/key-shifts-in-mathematics/) of 
Focus, Coherence and Rigor that are listed above. 


The IMET was developed by Student Achievement Partners. Educators may use or adapt, ©creative 
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Getting Started 


Prior to Evaluation 

Assemble all of the materials necessary for the evaluation. It is 
essential for evaluators to have materials for all grades covered by the 
program, as some criteria cannot be rated without having access to 
each grade. In addition, each evaluator should have a reference copy 
of the Common Core State Standards for Mathematics (CCSSM) and 
the Publishers’ Criteria for the Common Core State Standards for 
Mathematics, Grades K-8 (Spring 2013). 

Before conducting the evaluation itself, it is important to develop a 
protocol for the evaluation process. The protocol should include having 
evaluators study the Publishers’ Criteria and the IMET. It will also be 
helpful for evaluators to get a sense of each program overall before 
beginning the process. At a minimum, this would include reading the 
front matter of the text, looking at the table of contents and paging 
through multiple chapters. 

Sections 1-3 below should be completed to produce a comprehensive 
picture of the strengths and weaknesses of the materials under 
evaluation. Information about areas in need of improvement or 
supplementation should be shared with internal and external 
stakeholders. 

Navigating the Tool 

Begin with Section 1: Non-Negotiable Alignment Criteria (p. 121) 

• The Non-Negotiable Alignment Criteria must each be met in full 
for materials to be considered aligned to the Shifts and the major 
features of the Common Core State Standards. Each 
Non-Negotiable Alignment Criterion has one or more metrics 
associated with it; every one of these metrics must be met in 
order for the criterion as a whole to be met. 


• Examine the relevant materials and use evidence to rate the 
materials against each criterion and its associated metric(s). 

• Record and explain the evidence upon which the rating is based. 

Continue to Section 2: Alignment Criteria (p. 134) 

• The Alignment Criteria must each be met for materials to be 
considered aligned to the Shifts and the major features of the 
Common Core State Standards. Each Alignment Criterion has 
one or more metric associated with it; a specific number of these 
metrics must be met or partially met in order for the criterion as a 
whole to be met. 

• Examine the materials in relation to these criteria, assigning each 
metric a point value. Rate the criterion as “Meets” or “Does Not 
Meet” based on the number of points assigned. The more points 
the materials receive on the Alignment Criteria, the better they 
are aligned. 

• Record and explain the evidence upon which the rating is based. 

Complete Section 3: Evaluation Summary (p. 154) 

• Compile all of the results from Sections 1 and 2 to determine 

if the instructional materials are aligned to the Shifts and major 
features of the CCSS. 

Proceed to Section 4: Indicators of Quality (p. 156) 

• Indicators of Quality are important considerations that will help 
evaluators better understand the overall quality of instructional 
materials. These considerations are not criteria for alignment to 
the CCSS, but they provide valuable information about additional 
program characteristics. Evaluators may want to add their own 
indicators to the examples provided. 


The IMET was developed by Student Achievement Partners. Educators may use or adapt, ©creative 


http://creativecommons.Org/licenses/by/3.0/ 


Download this tool at http://achievethecore.org/IMET 


120 


Directions for Non-Negotiable 1 

Freedom from Obstacles to Focus 

Non-Negotiable 1: Materials must reflect the content architecture of the Standards by not assessing the 
topics named before the grade level where they first appear in the Standards. 


SECTION 2 

Instructional Materials Evaluation Toolkit (IMET) 

Mathematics, Grades K-8 


The Standards foster students’ progress to algebra by focusing strongly 
on arithmetic. Consistent with this focus, certain topics from outside 
of arithmetic appear only in later grades. Thus, to be aligned, materials 
must reflect the content architecture of the Standards by not assessing 
the topics named before the grade level where they first appear in the 
Standards. 


the only metric for Non-Negotiable 1 , the rating for Non-Negotiable 1 
is the same as the rating for Metric 1 A. 

If Metric 1 A is rated as Does Not Meet, include evidence of when the 
named topic(s) is/are assessed. If the metric is rated as Meets, list the 
grade(s) examined in the evaluation. 


Required Materials 

• Common Core State Standards for Mathematics 
(www.corestandards.org/wp-content/uploads/Math_Standards.pdf) 

• Publishers’ Criteria for the Common Core State Standards for 
Mathematics, Grades K-8 (Spring 2013) (http://www. 
corestandards.org/wp-content/uploads/Math_Publishers_ 
Criteria_K-8_Spring_2013_FINAL1.pdf) 

• From the materials being evaluated: teacher guides and all 
assessment components 


Rating this Criterion 

Non-Negotiable 1 is rated as Meets or Does Not Meet. 

To rate Non-Negotiable 1 , begin by rating Metric 1 A. Since Metric 1 A is 
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Non-Negotiable 1 

Freedom from Obstacles to Focus 


Metric 


How to Find the Evidence 


NN Metric 1A: 

Materials reflect the basic architecture of the 

Standards by not assessing the listed topics 

before the grade level indicated. 

■ Probability, including chance, likely 
outcomes, probability models. (Introduced 
in the CCSSM in grade 7) 

• Statistical distributions, including center, 
variation, clumping, outliers, mean, 
median, mode, range, quartiles; and 
statistical association or trends, including 
two-way tables, bivariate measurement 
data, scatter plots, trend line, line of best 
fit, correlation. (Introduced in the CCSSM 
in grade 6) 

• Similarity, congruence, or geometric 
transformations. (Introduced in the 
CCSSM in grade 8) 

• Symmetry of shapes, including line/ 
reflection symmetry, rotational symmetry. 
(Introduced in the CCSSM in grade 4) 


Evaluate the table of contents, all chapter 
tests, all unit tests, and other such 
assessment components (including rubrics). 

For context, read Criterion #2 from the 
Publishers’ Criteria for the Common Core 
State Standards for Mathematics, Grades 
K-8 (Spring 2013). NOTE: Grade alignments 
of other topics are addressed in Non- 
Negotiable 2, Focus and Coherence.) 
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Non-Negotiable 1 

Freedom from Obstacles to Focus 


SECTION 2 

Instructional Materials Evaluation Toolkit (IMET) 

Mathematics, Grades K-8 


Non-Negotiable 1: Materials must reflect the content architecture of the Standards by not assessing the 
topics named before the grade level where they first appear in the Standards. 


Rating for Non-Negotiable 1 


Rating 


If Metric 1 A was rated as Meets, then rate Non-Negotiable 1 as Meets. If Metric 1A was rated as Does Not Meet, then rate Non- 
Negotiable 1 as Does Not Meet. Check the final rating. 

Then, briefly describe the strengths and weaknesses of these materials in light of the above Criterion. 


] Meets 

□ Does Not Meet 


Strengths / Weaknesses: 


Before moving to Non-Negotiable 2, record the final Meets or Does Not Meet rating in the Evaluation Summary on Page 154. 
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Directions for Non-Negotiable 2 

Focus and Coherence 

Non-Negotiable 2: Materials must focus coherently on the Major Work of the grade in a way that is 
consistent with the progressions in the Standards. 


SECTION 2 

Instructional Materials Evaluation Toolkit (IMET) 

Mathematics, Grades K-8 


Focus and coherence are the two major evidence-based design 
principles of the Common Core State Standards for Mathematics 
(CCSSM, p. 3). Focus is necessary in order to fulfill the ambitious 
promise the states have made to their students by adopting the 
Standards: greater achievement at the college and career ready level; 
greater depth of understanding of mathematics; and a rich classroom 
environment in which reasoning, sense-making, applications, and a 
range of mathematical practices flourish. In simpler terms, a mile- 
wide, inch-deep curriculum translates to less time per topic. Less 
time means less depth and moving on without many students. Thus, 
materials must focus coherently on the Major Work of the grade in a 
way that is consistent with the progressions in the Standards. 


Required Materials 

• Common Core State Standards for Mathematics (http:// 
corestandards.org/wp-content/uploads/Math_Standards.pdf) 

• Publishers’ Criteria for the Common Core State Standards for 
Mathematics, Grades K-8 (Spring 2013) (http://www. 
corestandards.org/wp-content/uploads/Math_Publishers_ 
Criteria_K-8_Spring_2013_FINAL1.pdf) 


• Focus by Grade Level for the grade being evaluated (www. 
achievethecore.org/focus) 

• From the materials being evaluated: teacher guides, student 
texts and workbooks 


Rating this Criterion 

Non-Negotiable 2 is rated as Meets or Does Not Meet. 

To rate Non-Negotiable 2, first rate metrics 2A-2H. Each of these 
eight metrics must be rated as Meets in order for Non-Negotiable 
2 to be rated as Meets. Rate each metric 2A-2H as Meets or Does 
Not Meet/Insufficient Evidence. If the evidence examined shows that 
the Criterion is met, then mark the Criterion Meets. If the evidence 
examined shows that the Criterion is not met— or if there is insufficient 
evidence to make a determination— then mark the Criterion as Does 
Not Meet/Insufficient Evidence. Support all ratings with evidence. 
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Non-Negotiable 2 

Focus and Coherence 


Metric 

How to Find the Evidence 

NN Metric 2A: 

In each grade K-8, students and teachers 
using the materials as designed devote the 
large majority of time to the Major Work of 
the grade. 

Familiarize yourself with the Major Work of 
the grade being evaluated (see the Focus by 
Grade Level documents.) 

Evaluate the table of contents and any 
pacing guides. Do not stop there; also 
evaluate units, chapters, lessons, homework 
assignments, and assessments. (Evaluate 
both student and teacher materials.) 

Consider time spent on the Major Work of 
the grade and judge qualitatively whether 
students and teachers using the materials 
as designed will devote the large majority of 
time to the Major Work of the grade. 

For context, read Criterion #1 in the 
Publishers’ Criteria for the Common Core 
State Standards for Mathematics, Grades 
K-8 (Spring 2013). 
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Non-Negotiable 2 

Focus and Coherence 


Metric 


NN Metric 2B: 

Supporting Work, where present, enhances 
focus and coherence simultaneously by also 
engaging students in the Major Work of 
the grade. 


How to Find the Evidence 


Familiarize yourself with the Major Work 
and Supporting Work of the grade being 
evaluated (see the Focus by Grade Level 
documents.) 

Evaluate chapters and lessons that focus 
on Supporting Work. NOTE: Example of 
evaluating this Criterion might include 
looking at whether materials for K-5 
generally treat data displays as an occasion 
for solving grade-level word problems 
using the four operations (e.g., see 
3.MD.B.3); or whether materials for grade 
7 take advantage of opportunities to use 
probability to support ratios, proportions, 
and percentages. 

For context, read Criterion #3 in the 
Publishers’ Criteria for the Common Core 
State Standards for Mathematics, Grades 
K-8 (Spring 2013). 
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Non-Negotiable 2 

Focus and Coherence 


Metric 


How to Find the Evidence 


NN Metric 2C: 

Materials base content progressions on 
the grade-by-grade progressions in the 
Standards. Content from previous or future 
grades does not unduly interfere with or 
displace on-grade-level content. 


Evaluate the table of contents and any 
pacing guides. Do not stop there; also 
evaluate units, chapters, and lessons in both 
student and teacher materials. NOTE: In 
some cases it may be possible that aligned 
materials might address some aspects of a 
topic in a strategic way before or after the 
grade level in which the topic is central in 
the Standards’ progressions; for example, a 
curriculum author might purposefully choose 
to explore adding fractions with unlike 
denominators in a way appropriate to grade 
four, recognizing that this work is not really 
required until the next grade. However, any 
such purposeful discrepancies in content 
progressions should enhance the required 
learning in each grade; not unduly interfere 
with or displace grade-level content; and be 
clearly aimed at helping students meet the 
Standards as written rather than effectively 
rewriting the progressions in the Standards. 
And in all cases, note that Non-Negotiable 1 
must be met for materials to be aligned. 

For context, read Criterion #5a in the 
Publishers’ Criteria for the Common Core 
State Standards for Mathematics, Grades 
K-8 (Spring 2013). 
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Non-Negotiable 2 

Focus and Coherence 


Metric 


How to Find the Evidence 


NN Metric 2D: Evaluate both student and teacher materials. 

Materials give all students extensive work 

with on-grade-level problems. If the materials provide resources 

for differentiated learning, consider 
whether lower-performing students have 
opportunities to engage with grade-level 
problems. Also consider whether higher- 
performing students are given opportunities 
to learn current grade-level content in 
greater depth. 

For context, read Criterion #5b in the 
Publishers’ Criteria for the Common Core 
State Standards for Mathematics, Grades 
K-8 (Spring 2013). 
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Non-Negotiable 2 

Focus and Coherence 


Metric 


How to Find the Evidence 


NN Metric 2E: 

Materials relate on-grade-level concepts 
explicitly to prior knowledge from earlier 
grades. 


Evaluate both student and teacher 
materials. NOTE: Examples of evaluating 
this Criterion might include looking at the 
way the materials extend basic ideas of 
place value across the decimal point; or the 
role that properties of operations play when 
the materials extend arithmetic beyond 
whole numbers to fractions, variables, 
and expressions. More generally, cluster 
headings in the Standards sometimes 
signal key moments where reorganizing 
and extending previous knowledge is 
important in order to accommodate new 
knowledge (e.g., see cluster headings that 
use the phrase “Apply and extend previous 
understanding”). 


For context, read Criterion #5c in the 
Publishers’ Criteria for the Common Core 
State Standards for Mathematics, Grades 
K-8 (Spring 2013). 
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Non-Negotiable 2 

Focus and Coherence 


Metric 


NN Metric 2F: 

Review of material from previous grades is 
clearly identified as such to the teacher, and 
teacher and students can see what their 
specific responsibility is for the current year. 


How to Find the Evidence 


Evaluate the table of contents, but do not 
stop there; also evaluate units, chapters, 
lessons, homework assignments and 
assessments. (Evaluate both student and 
teacher materials.) Identify any content from 
previous grades and check whether it is 
identified as such. 

For context, read Criterion #5a in the 
Publishers’ Criteria for the Common Core 
State Standards for Mathematics, Grades 
K-8 (Spring 2013). 
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Non-Negotiable 2 

Focus and Coherence 


Metric 


NN Metric 2G: 

Materials include learning objectives that are 
visibly shaped by CCSSM cluster headings. 


How to Find the Evidence 


Select several clusters from the Major Work 
in the grade being evaluated. Evaluate 
teacher and student materials in relation to 
these clusters. 

For context, read Criterion #6a in the 
Publishers’ Criteria for the Common Core 
State Standards for Mathematics, Grades 
K-8 (Spring 2013). 
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Non-Negotiable 2 

Focus and Coherence 


Metric 


NN Metric 2H: 

Materials include problems and activities 
that serve to connect two or more clusters 
in a domain, or two or more domains in a 
grade, in cases where these connections are 
natural and important. 


How to Find the Evidence 


In the grade being evaluated, choose two or 
more clusters or two or more domains for 
which connections are natural 
and important. 

Evaluate the units, chapters, and lessons 
that deal with the chosen topics, looking for 
problems and activities that serve to connect 
the chosen clusters or domains. NOTE: An 
example of evaluating this Criterion might 
include looking at whether problems in 
grade 4 sometimes or often involve students 
applying their developing computation skills 
(detailed in domain NBT) in the context of 
solving word problems (detailed in domain 
OA). 

For context, read Criterion #6b in the 
Publishers’ Criteria for the Common Core 
State Standards for Mathematics, Grades 
K-8 (Spring 2013). 
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Non-Negotiable 2 

Focus and Coherence 

SECTION 2 

Instructional Materials Evaluation Toolkit (IMET) 

Mathematics, Grades K-8 


Non-Negotiable 2: Materials must focus coherently on the Major Work of the grade in a way that is 
consistent with the progressions in the Standards. 


Rating for Non-Negotiable 2 

Rating 

If all Metrics 2A - 2H were rated as Meets, then rate Non-Negotiable 2 as Meets. If one or more Metric was rated Does Not 
Meet/Insufficient Evidence, then rate Non-Negotiable 2 as Does Not Meet. Check the final rating. 

Then, briefly describe the strengths and weaknesses of these materials in light of the above Criterion. 

] Meets 
] Does Not Meet 


Strengths / Weaknesses: 


Before moving to Alignment Criterion 1, record the final Meets or Does Not Meet rating in the Evaluation Summary on Page 154. 


Now continue by evaluating the Alignment Criterion 1 for Rigor and Balance 
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Directions for Alignment Criterion 1 

Rigor and Balance 


SECTION 2 

Instructional Materials Evaluation Toolkit (IMET) 

Mathematics, Grades K-8 


Alignment Criterion 1: Materials must reflect the balances in the Standards and help students meet the 
Standards’ rigorous expectations. 


The Standards set expectations for attention to all three aspects of 
rigor: conceptual understanding, procedural skill and fluency, and 
applications. Thus, materials must reflect the balances in the Standards 
and help students meet the Standards’ rigorous expectations. 

Required Materials 

• Common Core State Standards for Mathematics (http:// 
corestandards.org/wp-content/uploads/Math_Standards.pdf) 

• Publishers’ Criteria for the Common Core State Standards for 
Mathematics, Grades K-8 (Spring 2013) (http://www. 
corestandards.org/wp-content/uploads/Math_Publishers_ 
Criteria_K-8_Spring_201 3_FINAL1 .pdf) 

• Focus by Grade Level for the grade being evaluated 
(achievethecore.org/focus) 

• Situation Types for the Operations in Word Problems 
(achievethecore.org/situation-types) 

• From the materials being evaluated: teacher guides, student 
texts and workbooks 


• Choose a cluster/Standard from the Major Work that is aligned 
to each aspect of rigor and use it to evaluate these metrics. It 
is most helpful if the same Clusters/Standards are chosen for all 
of the programs being evaluated. (Guidance in choosing 
Clusters/Standards is included in “How to Find the 
Evidence” below.) 

Rating this Criterion 

Alignment Criterion 1 is rated as Meets or Does Not Meet. 

To rate Alignment Criterion 1 , first rate metrics 1A, IB, and 1C. Rate 
each metric as Meets (2 points), Partially Meets (1 point), or Does Not 
Meet (0 points). For each metric, guiding questions are provided to aid 
in gathering evidence. 

Since there are three metrics, and each metric is worth up to 2 points, 
the maximum possible rating across all three metrics is 6 points. 
Ideally, aligned materials will earn all 6 points; materials are judged 
to have met Alignment Criterion 1 if the materials rate 5 or 6 points. 
This threshold recognizes that evaluators sometimes differ in how 
they assess features such as rigor and balance, while at the same 
time ensuring that no single metric can receive a rating of zero and be 
aligned to the Shifts and major features of the CCSSM. 
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Alignment Criterion 1 

Rigor and Balance 


SECTION 2 

Instructional Materials Evaluation Toolkit (IMET) 

Mathematics, Grades K-8 


Use the questions on this page to evaluate Metric 1A. On page 136, record evidence for each question 
and rate Metric 1A. 


Metric 


How to Find the Evidence Questions for Metric 


AC Metric 1A: 

The materials support the development of 
students’ conceptual understanding of key 
mathematical concepts, especially where 
called for in specific content Standards or 
cluster headings. 


Select one or more cluster(s) or Standard(s) 
from the Major Work for the grade being 
evaluated that relate specifically conceptual 
understanding to use throughout the 
questions associated with this metric. NOTE: 
Some examples of clusters or Standards 
that call for conceptual understanding 
include: K.OA.A.1, (1.NBT.B, 1.NBT.C), 
(2.NBT.A, 2.NBT.B), (3.0A.A.1 , 3.0A.A.2), 

4. NF.A, (4.NBT.A, 4.NBT.B), 5.NF.B, (5.NBT.A, 

5. NBT.B), 6.RP.A, 6.EE.A.3, 7.NS.A, 7.EE.A, 
8.EE.B, 8.F.A, 8.G.A 

Clusters or Standards grouped by 
parentheses are closely connected and 
could be analyzed together. 


Is conceptual understanding attended to thoroughly where the Standards set explicit 
expectations for understanding or interpreting? Evaluate lessons, chapter/unit assessments 
and homework assignments, paying attention to work aligned to Standards that explicitly call 
for understanding or interpreting. NOTE: Examples of evaluating this Criterion might include 
looking at how well the multi-digit addition and subtraction algorithms are developed and 
explained on the basis of place value and properties of operations; or how well the multi-digit 
multiplication and division algorithms are developed and explained on the basis of place value 
and properties of operations; or how well solving equations is presented and explained as a 
process of reasoning. 


Do the materials feature high-quality conceptual problems and conceptual discussion 
questions? Evaluate lessons, chapter/unit assessments, and homework assignments. 
NOTE: Example of conceptual problems might include such questions as “Find a number 
greater than Vs and less than V4,” or “If the divisor does not change and the dividend 
increases, what happens to the quotient?” 


For context, read Criterion #4a in the 
Publishers’ Criteria for the Common Core 
State Standards for Mathematics, Grades 
K-8 (Spring 2013). 


Do the materials feature opportunities to identify correspondences across mathematical 
representations? Evaluate lessons, chapter/unit assessments and homework assignments. 
NOTE: Examples of evaluating this Criterion might include looking at whether students are 
supported in identifying correspondences among: the verbal description of a situation, the 
diagrams that distill its mathematical features, and the equations that model it; or equivalent 
forms of numbers (e.g., 3 and e h) and the number line; or rational number operations and 
representations of them via models such as the vector model; or the expression that defines a 
function and the graph that shows the relationship. 
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Alignment Criterion 1 

Rigor and Balance 


SECTION 2 

Instructional Materials Evaluation Toolkit (IMET) 

Mathematics, Grades K-8 


Metric 


Evidence 


AC Metric 1A: Is conceptual understanding attended to thoroughly where the Standards set explicit expectations for understanding or interpreting? 

The materials support the development of 

students’ conceptual understanding of key 

mathematical concepts, especially where 

called for in specific content Standards or 

cluster headings. 


Do the materials feature high-quality conceptual problems and conceptual discussion questions? 


Do the materials feature opportunities to identify correspondences across mathematical representations? 


Rating 


] Meets (2) 

] Partially Meets (1) 
□ Does Not Meet (0) 
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Alignment Criterion 1 

Rigor and Balance 


SECTION 2 

Instructional Materials Evaluation Toolkit (IMET) 

Mathematics, Grades K-8 


Use the questions on this page to evaluate Metric IB. On page 138, record evidence for each question 
and rate Metric 1 B. 


Metric 


How to Find the Evidence Questions for Metric 


AC Metric 1 B: 

The materials are designed so that students 
attain the fluencies and procedural skills 
required by the Standards. 


Select one or more cluster(s) or Standard(s) 
from the Major Work for the grade being 
evaluated that relate specifically to fluency 
and procedural skill to use throughout the 
questions associated with this metric. NOTE: 
Some examples of Standards that call for 
procedural skill and fluency include: 
K.OA.A.5, I.OA.C.6, 2.0A.B.2, 2.NBT.B.5, 
3.0A.C.7, 3.NBT.A.2, 4.NBT.B.4, 5.NBT.B.5, 

6. NS.B.2, and 6.NS.B.3, 6.EE.A, 7.NS.A, 

7. EE.A.1 ,7.EE.B.4a, 8.EE.C.7, 8.EE.C.8b 

For context, read Criterion #4b in the 
Publishers’ Criteria for the Common Core 
State Standards for Mathematics, Grades 
K-8 (Spring 2013). 


Is progress toward fluency and procedural skill interwoven with students’ developing 
conceptual understanding of the operations in question? Evaluate lessons, chapter/unit 
assessments, daily routines, and homework assignments for evidence that the development of 
fluency and procedural skill is supported by conceptual understanding. 


Are purely procedural problems and exercises present that include cases in which opportunistic 
strategies are valuable and generic cases that require efficient algorithms present? Evaluate 
lessons, chapter/unit assessments, daily routines, and homework assignments. NOTE: Examples 
of problems in which opportunistic strategies are valuable might include the sum 698 + 240 or the 
system x + y = 1 , 2x + 2y = 3. Examples of generic cases that require efficient algorithms might 
include the sum 8767+2286 or the system 6y + x =|x + 3, -|x = 1 + 2y. 


Do the materials in grades K-6 provide repeated practice toward attainment of fluency 
Standards? Evaluate lessons, daily routines, and homework assignments for evidence of 
repeated practice toward attainment of the following K-6 Standards that set an explicit 
expectation of fluent (accurate and reasonably fast) computation: K.OA.A.5, 1 .OA.C.6, 
2.0A.B.2, 2.NBT.B.5, 3.0A.C.7, 3.NBT.A.2, 4.NBT.B.4, 5.NBT.B.5, 6.NS.B.2, 6.NS.B.3. 
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Alignment Criterion 1 

Rigor and Balance 


SECTION 2 

Instructional Materials Evaluation Toolkit (IMET) 

Mathematics, Grades K-8 


Metric 


Evidence 


AC Metric IB: Is progress toward fluency and procedural skill interwoven with students’ developing conceptual understanding of the operations in question? 

The materials are designed so that students 
attain the fluencies and procedural skills 
required by the Standards. 


Are purely procedural problems and exercises present that include cases in which opportunistic strategies are valuable and generic cases that 
require efficient algorithms present? 


Do the materials in grades K-6 provide repeated practice toward attainment of fluency Standards? 


Rating 


] Meets (2) 

] Partially Meets (1) 
] Does Not Meet (0) 
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SECTION 2 

Instructional Materials Evaluation Toolkit (IMET) 

Mathematics, Grades K-8 

Use the questions on this page to evaluate Metric 1C. On page 140, record evidence for each question 
and rate Metric 1 C. 


Alignment Criterion 1 

Rigor and Balance 


Metric 


How to Find the Evidence Questions for Metric 


AC Metric 1C: 

The materials are designed so that teachers 
and students spend sufficient time working 
with engaging applications, without losing 
focus on the Major Work of each grade. 


Select one or more cluster(s) or Standard(s) 
from the Major Work for the grade being 
evaluated that relate specifically application 
to use throughout the questions associated 
with this metric. NOTE: Some examples of 
clusters or Standards that call for application 
include: K.OA.A.2, I.OA.A, 2.0A.A, 

3.0A.A.3, 3.0A.D.8, 4.0A.A.3, 4.NF.B.3d, 

4. NEB. 4c, 5.NF.B.6, 5.NF.B.7C, 6.RP.A.3, 

6. NS.A.1 , 6.EE.B.7, 6.EE.C.9, 7.RP.A, 

7. NS.A.3, 7.EE.B.3, 8.EE.C.8c, 8.F.B 

For context, read Criterion #4c in the 
Publishers’ Criteria for the Common Core 
State Standards for Mathematics, Grades 
K-8 (Spring 2013). 


Are there are single- and multi-step contextual problems, including non-routine problems, 
that develop the mathematics of the grade, afford opportunities for practice, and engage 
students in problem solving? Do the problems attend thoroughly to those places in the content 
Standards where expectations for multi-step and real-world problems are explicit? Evaluate 
lessons, chapter/unit assessments, and homework assignments. 


Do application problems particularly stress applying the Major Work of the grade? Evaluate 
lessons, chapter/unit assessments, and homework assignments. NOTE: Examples of 
evaluating this Criterion might include looking at: how well, by the end of grade 2, students 
using the materials as designed can represent and solve a full range of one-step addition and 
subtraction word problems; or how well, by the end of grade 3, students using the materials 
as designed can represent and solve a full range of one-step multiplication and division word 
problems; or how well these basic situation types for each operation are carried coherently 
across the grades, (e.g., with fractions and algebraic expressions); or, in all grades, whether the 
problems connect concepts, Standards, and domains in ways that are natural and important. 
For a list of situation types for one-step addition, subtraction, multiplication, and division 
problems, see Situation Types for the Operations in Word Problems 


Does modeling build slowly across K-8, with applications that are relatively simple in earlier 
grades and when students are encountering new content? In grades 6-8, do the problems 
begin to provide opportunities for students to make their own assumptions or simplifications in 
order to model a situation mathematically? Read Standard for Mathematical Practice 4, Model 
with Mathematics. Evaluate lessons, chapter/unit assessments, and homework assignments. 
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Alignment Criterion 1 

Rigor and Balance 


SECTION 2 

Instructional Materials Evaluation Toolkit (IMET) 

Mathematics, Grades K-8 


Metric 


Evidence 


AC Metric 1C: Are there are single- and multi-step contextual problems, including non-routine problems, that develop the mathematics of the grade, afford 

The materials are designed so that teachers opportunities for practice, and engage students in problem solving? Do the problems attend thoroughly to those places in the content Standards 

and students spend sufficient time working where expectations for multi-step and real-world problems are explicit? 

with engaging applications, without losing 
focus on the Major Work of each grade. 


Do application problems particularly stress applying the Major Work of the grade? 


Does modeling build slowly across K-8, with applications that are relatively simple in earlier grades and when students are encountering new 
content? In grades 6-8, do the problems begin to provide opportunities for students to make their own assumptions or simplifications in order to 
model a situation mathematically? 


Rating 


] Meets (2) 

] Partially Meets (1) 
] Does Not Meet (0) 
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Alignment Criterion 1 

Rigor and Balance 

SECTION 2 

Instructional Materials Evaluation Toolkit (IMET) 

Mathematics, Grades K-8 


Alignment Criterion 1: Materials must reflect the balances in the Standards and help students meet the 
Standards’ rigorous expectations. 


Points Assigned for Alignment Criterion 1 

Rating 

Materials must earn at least 5 out of 6 points to meet this Alignment Criterion. If materials earn less than 5 out of 6 points, the 
Criterion has not been met. Check the final rating. 

Total (6 points possible) 

Then, briefly describe the strengths and weaknesses of these materials in light of the above Criterion. 

] Meets 
] Does Not Meet 


Strengths / Weaknesses: 


Before moving to Alignment Criterion 2, record the final Meets or Does Not Meet rating in the Evaluation Summary on Page 154. 
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Directions for Alignment Criterion 2 

Standards for Mathematical Practice 


SECTION 2 

Instructional Materials Evaluation Toolkit (IMET) 

Mathematics, Grades K-8 


Alignment Criterion 2: Materials must demonstrate authentic connections between content Standards 
and practice Standards. 


The Standards require that designers of instructional materials 
connect the mathematical practices to mathematical content in 
instruction. Thus, materials must demonstrate authentic connections 
between content Standards and practice Standards. 

Required Materials 

• Common Core State Standards for Mathematics (http:// 
corestandards.org/wp-content/uploads/Math_Standards.pdf) 

• Publishers’ Criteria for the Common Core State Standards for 
Mathematics, Grades K-8 (Spring 2013) (http://www. 
corestandards.org/wp-content/uploads/Math_Publishers_ 
Criteria_K-8_Spring_2013_FINAL1.pdf) 

• Focus by Grade Level for the grade being evaluated (www. 
achievethecore.org/focus) 

• From the materials being evaluated: teacher guides, student 
texts and workbooks 


Rating this Criterion 

Alignment Criterion 2 is rated as Meets or Does Not Meet. 

To rate Alignment Criterion 2, first rate metrics 2A, 2B, and 2C. Rate 
each metric as Meets (2 points), Partially Meets (1 point), or Does Not 
Meet (0 points). For each metric, guiding questions are provided to aid 
in gathering evidence. 

Since there are three metrics, and each metric is worth up to 2 points, 
the maximum possible rating across all three metrics is 6 points. 
Ideally, aligned materials will earn all 6 points; materials are judged 
to have met Alignment Criterion 2 if the materials earn 5 or 6 points. 
This threshold recognizes that evaluators sometimes differ in how they 
assess features such as mathematical practices, while at the same 
time ensuring that no single metric can receive a rating of zero and be 
aligned to the Shifts and major features of the CCSSM. 
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Alignment Criterion 2 

Standards for Mathematical Practice 


Metric 

How to Find the Evidence 

AC Metric 2A: 

Materials address the practice Standards in 
such a way as to enrich the Major Work of 
the grade; practices strengthen the focus on 
Major Work instead of detracting from it, in 
both teacher and student materials. 

Familiarize yourself with the Major Work of 
the grade being evaluated (see the Focus by 
Grade Level documents.) 

Evaluate teacher and student materials for 
evidence that the mathematical practices 
support and connect to the focus of the 
grade. NOTE: Examples of evaluating this 
Criterion might include looking at whether, in 
grades K-5, students using the materials are 
supported to look for and express regularity 
in repeated reasoning about the addition 
table, the multiplication table, the properties 
of operations, the relationship between 
addition and subtraction or multiplication 
and division, and the place value system; 
or whether, in grades 6-8, students using 
the materials are supported to look for and 
express regularity in repeated reasoning 
about proportional relationships and linear 
functions. 


For context, read Criterion #8 in the 
Publishers’ Criteria for the Common Core 
State Standards for Mathematics, Grades 
K-8 (Spring 2013). 


Published v.2 201 4 - send feedback to info@studentsachieve.net Reviewer Initials: 


SECTION 2 
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Mathematics, Grades K-8 


Evidence 


Rating 


□ Meets (2) 

□ Partially Meets (1) 

□ Does Not Meet (0) 
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Alignment Criterion 2 

Standards for Mathematical Practice 


SECTION 2 

Instructional Materials Evaluation Toolkit (IMET) 

Mathematics, Grades K-8 


Use the questions on this page to evaluate Metric 2B. On page 145, record evidence for each question 
and rate Metric 2B. 


Metric 

How to Find the Evidence 

Questions for Metric 

AC Metric 2B: 

Materials attend to the full meaning of each 
practice Standard. 

For context, read Criterion #7 and 
Criterion #9 in the Publishers’ Criteria for 
the Common Core State Standards for 
Mathematics, Grades K-8 (Spring 2013). 

Over the course of any given year of instruction, is each mathematical practice Standard 
meaningfully present in the form of assignments, activities, or problems that stimulate students 
to develop the habits of mind described in the practice Standard? Evaluate lessons, chapter/ 
unit assessments, and homework assignments for evidence of each mathematical practice 
being meaningfully present in instruction. 


Do the materials treat the practice Standards as developing across grades or grade bands? 
Are the practice Standards in early grades appropriately simple? Do they display an arc of 
growing sophistication across the grades? Evaluate lessons, chapter/unit assessments, and 
homework assignments. 


Are there teacher-directed materials that explain the role of the practice Standards in the 
classroom and in students’ mathematical development? Are alignments to practice Standards 
accurate? Evaluate teacher materials, paying attention to explanations of the role of the 
practice Standards in the classroom and in students’ mathematical development. Evaluate 
documents aligning lessons to practice Standards for accuracy. NOTE: Examples to look for 
when evaluating this metric might include the following: a highly scaffolded problem should 
not be aligned to MP.1 ; or a problem that directs a student to use a calculator should not be 
aligned to MP.5; or a problem about merely extending a pattern should not be aligned to MP.8. 
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Alignment Criterion 2 

Standards for Mathematical Practice 


SECTION 2 

Instructional Materials Evaluation Toolkit (IMET) 

Mathematics, Grades K-8 


Metric 


Evidence 


AC Metric 2B: Over the course of any given year of instruction, is each mathematical practice Standard meaningfully present in the form of assignments, 

Materials attend to the full meaning of each activities, or problems that stimulate students to develop the habits of mind described in the practice Standard? 
practice Standard. 


Do the materials treat the practice Standards as developing across grades or grade bands? Are the practice Standards in early grades 
appropriately simple? Do they display an arc of growing sophistication across the grades? 


Are there teacher-directed materials that explain the role of the practice Standards in the classroom and in students’ mathematical development? 
Are alignments to practice Standards accurate? 


Rating 


] Meets (2) 

] Partially Meets (1) 
] Does Not Meet (0) 
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Alignment Criterion 2 

Standards for Mathematical Practice 


SECTION 2 

Instructional Materials Evaluation Toolkit (IMET) 

Mathematics, Grades K-8 


Use the questions on this page to evaluate Metric 2C. On page 147, record evidence for each question 
and rate Metric 2C. 


Metric 

How to Find the Evidence 

Questions for Metric 

AC Metric 2C: 

Materials support the Standards’ emphasis 
on mathematical reasoning. 

For context, read Criterion #1 0 in the 
Publishers’ Criteria for the Common Core 
State Standards for Mathematics, Grades 
K-8 (Spring 2013). 

Do the materials support students in constructing viable arguments and critiquing the 
arguments of others concerning grade-level mathematics that is detailed in the content 
Standards? Read Standard for Mathematical Practice 3. Evaluate teacher and student 
materials to ensure that students are given opportunities to reason with grade-level 
mathematics. 


Do the materials support students in producing not only answers and solutions, but also, in 
a grade-appropriate way, arguments, explanations, diagrams, mathematical models, etc., 
especially in the Major Work of the grade? Familiarize yourself with the Major Work of the grade 
being evaluated (see the Focus by Grade Level documents.) Evaluate teacher and student 
materials, to understand the types of work students are expected to produce. 


Do materials explicitly attend to the specialized language of mathematics? Is the language 
of argument, problem solving, and mathematical explanations taught rather than assumed? 
Evaluate teacher and student materials, paying attention to how mathematical language 
is taught. NOTE: Examples of evaluating this Criterion might include looking at whether 
students are supported in: basing arguments on definitions; using the method of providing a 
counterexample; or recognizing that examples alone do not establish a general statement. 
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Alignment Criterion 2 

Standards for Mathematical Practice 


SECTION 2 

Instructional Materials Evaluation Toolkit (IMET) 

Mathematics, Grades K-8 


Metric 


Evidence 


AC Metric 2C: Do the materials support students in constructing viable arguments and critiquing the arguments of others concerning grade-level mathematics 

Materials support the Standards’ emphasis that is detailed in the content Standards? 
on mathematical reasoning. 


Do the materials support students in producing not only answers and solutions, but also, in a grade-appropriate way, arguments, explanations, 
diagrams, mathematical models, etc., especially in the Major Work of the grade? 


Do materials explicitly attend to the specialized language of mathematics? Is the language of argument, problem solving, and mathematical 
explanations taught rather than assumed? 


Rating 


□ Meets (2) 

□ Partially Meets (1) 

□ Does Not Meet (0) 
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Alignment Criterion 2 

Standards for Mathematical Practice 

SECTION 2 

Instructional Materials Evaluation Toolkit (IMET) 

Mathematics, Grades K-8 


Alignment Criterion 2: Materials must demonstrate authentic connections between content Standards 
and practice Standards. 


Points Assigned for Alignment Criterion 2 

Rating 

Materials must earn at least 5 out of 6 points to meet this Alignment Criterion. If materials earn less than 5 out of 6 points, the 
Criterion has not been met. Check the final rating. 

Total (6 points possible) 

Then, briefly describe the strengths and weaknesses of these materials in light of the above Criterion. 

] Meets 
] Does Not Meet 


Strengths / Weaknesses: 


Before moving to Alignment Criteria 3, record the final Meets or Does Not Meet rating in the Evaluation Summary on Page 154. 
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Directions for Alignment Criterion 3 

Access to the Standards for All Students 


SECTION 2 

Instructional Materials Evaluation Toolkit (IMET) 

Mathematics, Grades K-8 


Alignment Criterion 3: Materials must provide supports for English Language Learners and other special 
populations. 


Because Standards are for all students, alignment requires thoughtful 
support to ensure all students are able to meet the Standards. 

Thus, aligned materials must provide supports for English Language 
Learners and other special populations. 

Required Materials 

• Common Core State Standards for Mathematics (http:// 
corestandards.org/wp-content/uploads/Math_Standards.pdf) 

• Publishers’ Criteria for the Common Core State Standards for 
Mathematics, Grades K-8 (Spring 2013) (http://www. 
corestandards.org/wp-content/uploads/Math_Publishers_ 
Criteria_K-8_Spring_201 3_FINAL1 .pdf) 

• From the materials being evaluated: teacher guides, student 
texts and workbooks 


Rating this Criterion 

Alignment Criterion 3 is rated as Meets or Does Not Meet. 

To rate Alignment Criterion 3, first rate metrics 3A, 3B, and 3C. Rate 


each metric as Meets (2 points), Partially Meets (1 point), or Does Not 
Meet (0 points). 

Since there are three metrics, and each metric is worth up to 2 points, 
the maximum possible rating across all three metrics is 6 points. 
Ideally, aligned materials will earn all 6 points; materials are judged 
to have met Alignment Criterion 3 if the materials earn 5 or 6 points. 
This threshold recognizes that evaluators sometimes differ in how they 
assess features such as support for special population, while at the 
same time ensuring that no single metric can receive a rating of zero 
and be aligned to the Shifts and major features of the CCSSM. 
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Alignment Criterion 3 

Access to the Standards for All Students 


Metric 


How to Find the Evidence 


AC Metric 3A: 

Support for English Language Learners 
and other special populations is thoughtful 
and helps those students meet the same 
Standards as all other students. The 
language in which problems are posed is 
carefully considered. 


Evaluate teacher and student materials, 
paying attention to supports offered for 
special populations. 
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Mathematics, Grades K-8 


Evidence 


Rating 


] Meets (2) 

] Partially Meets (1) 
] Does Not Meet (0) 
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Alignment Criterion 3 

Access to the Standards for All Students 


SECTION 2 

Instructional Materials Evaluation Toolkit (IMET) 

Mathematics, Grades K-8 


Metric 


How to Find the Evidence Evidence 


AC Metric 3B: 

Materials provide appropriate level and type 
of scaffolding, differentiation, intervention, 
and support for a broad range of learners 
with gradual removal of supports, when 
needed, to allow students to demonstrate 
their mathematical understanding 
independently. 


Evaluate teacher and student materials, 
paying attention to whether materials provide 
differentiation that will lead all learners to 
engage with on-grade-level content. 


Rating 
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Alignment Criterion 3 

Access to the Standards for All Students 


Metric 

How to Find the Evidence 

AC Metric 3C: 

Design of lessons recommends and 
facilitates a mix of instructional approaches 
for a variety of learners such as using 
multiple representations (e.g., including 
models, using a range of questions, 
checking for understanding, flexible 
grouping, pair-share). 

Evaluate teacher materials, noting 
instructional approaches suggested for 
whole class and differentiated lessons and 
activities. 
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SECTION 2 

Instructional Materials Evaluation Toolkit (IMET) 

Mathematics, Grades K-8 


Evidence 


Rating 


] Meets (2) 

] Partially Meets (1) 
] Does Not Meet (0) 


Title of Program: 


152 


Alignment Criterion 3 

Access to the Standards for All Students 

SECTION 2 

Instructional Materials Evaluation Toolkit (IMET) 

Mathematics, Grades K-8 


Alignment Criterion 3: Materials must provide supports for English Language Learners and other special 
populations. 


Points Assigned for Alignment Criterion 3 

Rating 

Materials must earn at least 5 out of 6 points to meet this Alignment Criterion. If materials earn less than 5 points, the Criterion 
has not been met. Check the final rating. 

Total (6 points possible) 

Then, briefly describe the strengths and weaknesses of these materials in light of the above Criterion. 

] Meets 
] Does Not Meet 


Strengths / Weaknesses: 


Move to the Evaluation Summary on the following page to record the final Meets or Does Not Meet rating. 
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IMET Evaluation Summary 1 of 2 


SECTION 2 

Instructional Materials Evaluation Toolkit (IMET) 

Mathematics, Grades K-8 


Program: 

Publisher: 

Date of Publication: 


Name of Evaluator(s): 

Date of Evaluation: 

Signature of Each Evaluator(s): 


Non-Negotiable Criteria 


Alignment Criteria 


Each Non-Negotiable must be met in order 
for the Non-Negotiable Alignment Criteria to 
be met overall. 

Non-Negotiable 1: 

Freedom from Obstacles to Focus 

] Meets 

□ Does Not Meet 

Non-Negotiable 2: 

Focus and Coherence 


Each Alignment Criterion must be met with a sufficient number of points in order for Alignment Criteria to be labeled as “Meets” overall. The more 
points the materials receive on the Alignment Criteria, the better they are aligned. 


Alignment Criterion 1: 

Rigor and Balance 

Points: of 6 possible. 

(Materials must receive at least 5 of 6 points 
to align.) 

□ Meets 

□ Does Not Meet 


Alignment Criterion 2: 

Standards for Mathematical Practice 

Points: of 6 possible. 

(Materials must receive at least 5 of 6 points 
to align.) 

□ Meets 

] Does Not Meet 


Alignment Criterion 3: 

Access to Standards for All Learners 

Points: of 6 possible. 

(Materials must receive at least 5 of 6 points 
to align.) 

□ Meets 

] Does Not Meet 


□ Meets 

] Does Not Meet 

Non-Negotiables Overall Alignment Criteria Overall 


] Meets 

] Meets 

] Does Not Meet 

] Does Not Meet 
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IMET Evaluation Summary 2 of 2 


Program: 

Publisher: 

Date of Publication: 


Summary 


If the materials meet both Non-Negotiables and relevant Alignment Criterion, they are aligned 
to the Shifts and major features of the CCSS. 

Do the materials meet every Non-Negotiable and Alignment Criterion? 

□ Yes 

□ No 


What are the specific areas of strength and weakness based on this evaluation? 

Publishers or others modifying or developing assessments can use this information to make 
improvements and/or to remedy gaps in the alignment of assessment materials. 
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Indicators of Quality 


SECTION 2 

Instructional Materials Evaluation Toolkit (IMET) 

Mathematics, Grades K-8 


Once an evaluation for alignment to the Shifts and major features of the CCSS has been conducted using Sections 1-3, it’s important to evaluate 
for overall quality and best practices. A starting list of Indicators of Quality are suggested below. States, districts and others evaluating instructional 
materials are encouraged to add to this list to ensure materials reflect local contexts. For background information on some of the Indicators of Quality in 
this section, refer to pp. 18-21 in the Publishers’ Criteria for the Common Core State Standards for Mathematics, Grades K-8 (Spring 2013). 


Indicators 


Evidence 


Rating (Y/N) 


1 . Lessons are thoughtfully structured and support the 
teacher in leading the class through the learning paths at 
hand, with active participation by all students in their own 
learning and in the learning of their classmates. 

2. The underlying design of the materials includes both 
problems and exercises. (In solving problems, students 
learn new mathematics, whereas in working exercises, 
students apply what they have already learned to build 
mastery.) Each problem or exercise has a purpose. 

NOTE: This Criterion does not require that the problems 
and exercises be labeled as such. 


3. Design of assignments is not haphazard: exercises 
are given in intentional sequences in order to strengthen 
students’ mathematical understanding. 
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Indicators of Quality 


Indicators 


4. There are separate teacher materials that support and 
reward teacher study including, but not limited to: 
discussion of the mathematics of the units and the 
mathematical point of each lesson as it relates to the 
organizing concepts of the unit, discussion on student 
ways of thinking and anticipating a variety of students 
responses, guidance on lesson flow, guidance on 
questions that prompt students thinking, and discussion 
of desired mathematical behaviors being elicited 
among students. 

5. Manipulates suggested in the materials are faithful 
representations of the mathematical objects they represent 
and are connected to written methods. 


6. Materials include a variety of curriculum-embedded 
assessments. Examples include pre-, formative, 
summative, and self-assessment resources. 

7. Assessments contain aligned rubrics, answer keys, 

and scoring guidelines that provide sufficient guidance for 
interpreting student performance. 

8. Materials assess student proficiency using methods that 
are accessible and unbiased, including the use of grade- 
level language in student prompts. 
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Indicators of Quality 


Indicators 


Evidence 


9. Materials are carefully evaluated by qualified individuals, 
whose names are listed, in an effort to ensure freedom 
from mathematical errors and grade-level appropriateness. 


10. The visual design supports students in engaging 

thoughtfully with the subject. Navigation through the text 
is clear. 


1 1 . The materials engage parents in appropriate ways. For 
example, homework assignments in elementary grades, 
consist of routine problems, practice with getting 
answers, and fluency-building exercises that parents can 
easily support. 
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Evaluation Toolkit (IMET) 


Mathematics, High School 


159 


Instructional Materials Evaluation Tool 

Mathematics, High School 

What Are the Purposes of the IMET? 


This Math IMET is designed to help educators determine whether 
instructional materials are aligned to the Shifts and major features of the 
Common Core State Standards (CCSS). The substantial instructional 
Shifts (http://www.corestandards.org/other-resources/key-shifts-in- 
mathematics/) at the heart of the Common Core State Standards are: 

• Focus strongly where the Standards focus 

• Coherence: Think across grades and link to major topics within 
the grade 

• Rigor: In major topics, pursue conceptual understanding, 
procedural skill and fluency, and application with equal intensity. 

The IMET draws directly from the following documents: 

• Common Core State Standards for Mathematics 
(www.corestandards.org/Math) 

• Publishers’ Criteria for the Common Core State Standards for 
Mathematics, High School (Spring 2013) (http://www. 
corestandards.org/wp-content/uploads/Math_Publishers_Criteria_ 
HS_Spring_201 3_FINAL1 .pdf) 

When to use the IMET 

1. Purchasing materials: Many factors go into local purchasing 
decisions. Alignment to the Standards is a critical factor to 
consider. This tool is designed to evaluate alignment of 
instructional materials to the Shifts and the major features of 
the CCSS. It also provides suggestions of additional indicators 
to consider in the materials evaluation and purchasing process. 


2. Evaluating materials currently in use: The IMET can be used to 
analyze the degree of alignment of existing materials and help to 
highlight specific, concrete flaws in alignment. Even where 
materials and tools currently in use fail to meet one or more of 
these criteria, the pattern of failure is likely to be informative. 
States and districts can use the evaluation to create a thoughtful 
plan to modify or combine existing resources in such a way that 
students’ actual learning experiences approach the focus, 
coherence, and rigor of the Standards. 

3. Developing programs: Those developing new programs can use 
this tool as guidance for creating aligned curricula. 

Please note this tool was designed for evaluating comprehensive 
curricula (including any supplemental or ancillary materials), but it was 
not designed for the evaluation of standalone supplemental materials. 


Who Uses the IMET? 

Evaluating instructional materials requires both subject-matter and 
pedagogical expertise. Evaluators should be well versed in the 
Standards (www.corestandards.org/Math) for all grades in which 
materials are being evaluated. This includes understanding the Widely 
Applicable Prerequisites (www.achievethecore.org/prerequisites), 
how the content fits into the progressions in the Standards (www. 
achievethecore.org/progressions), and the expectations of the 
Standards with respect to conceptual understanding, procedural skill 
and fluency, and application. Evaluators also should be familiar with the 
substantial instructional Shifts (http://www.corestandards.org/other- 
resources/key-shifts-in-mathematics/) of Focus, Coherence and Rigor 
that are listed above. 


The IMET was developed by Student Achievement Partners. Educators may use or adapt, ©creative 
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Getting Started 


Prior to Evaluation 

Assemble all of the materials necessary for the evaluation. It is 
essential for evaluators to have materials for all grades covered by the 
program, as some criteria cannot be rated without having access to 
each grade. In addition, each evaluator should have a reference copy 
of the Common Core State Standards for Mathematics (CCSSM) and 
the Publishers’ Criteria for the Common Core State Standards for 
Mathematics, High School (Spring 2013). 

Before conducting the evaluation itself, it is important to develop a 
protocol for the evaluation process. The protocol should include having 
evaluators study the Publishers’ Criteria and the IMET. It will also be 
helpful for evaluators to get a sense of each program overall before 
beginning the process. At a minimum, this would include reading the 
front matter of the text, looking at the table of contents and paging 
through multiple chapters. 

Sections 1-3 below should be completed to produce a comprehensive 
picture of the strengths and weaknesses of the materials under 
evaluation. Information about areas in need of improvement or 
supplementation should be shared with internal and external 
stakeholders. 

Navigating the Tool 

Begin with Section 1: Non-Negotiable Alignment Criteria (p. 162) 

• The Non-Negotiable Alignment Criterion must be met in full 
for materials to be considered aligned to the Shifts and the 
major features of the Common Core State Standards. The Non- 
Negotiable Alignment Criterion has metrics associated with it; 
every one of these metrics must be met in order for the criterion 
as a whole to be met. 


• Examine the relevant materials and use evidence to rate the 
materials against each criterion and its associated metric(s). 

• Record and explain the evidence upon which the rating is based. 

Continue to Section 2: Alignment Criteria (p. 172) 

• The Alignment Criteria must each be met for materials to be 
considered aligned to the Shifts and the major features of the 
Common Core State Standards. Each Alignment Criterion has 
one or more metric associated with it; a specific number of these 
metrics must be met or partially met in order for the criterion as a 
whole to be met. 

• Examine the materials in relation to these criteria, assigning each 
metric a point value. Rate the criterion as “Meets” or “Does Not 
Meet” based on the number of points assigned. The more points 
the materials receive on the Alignment Criteria, the better they 
are aligned. 

• Record and explain the evidence upon which the rating is based. 

Complete Section 3: Evaluation Summary (p. 192) 

• Compile all of the results from Sections 1 and 2 to determine 

if the instructional materials are aligned to the Shifts and major 
features of the CCSS. 

Proceed to Section 4: Indicators of Quality (p. 194) 

• Indicators of Quality are important considerations that will help 
evaluators better understand the overall quality of instructional 
materials. These considerations are not criteria for alignment to 
the CCSS, but they provide valuable information about additional 
program characteristics. Evaluators may want to add their own 
indicators to the examples provided. 
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Directions for Non-Negotiable 1 

Focus and Coherence 

Non-Negotiable 1: Materials must focus coherently on the Widely Applicable Prerequisites in a way that 
is consistent with the progressions in the Standards. 


SECTION 2 

Instructional Materials Evaluation Toolkit (IMET) 

Mathematics, High School 


Focus and coherence are the two major evidence-based design 
principles of the Common Core State Standards for Mathematics 
(CCSSM, p. 3). Focus is necessary in order to fulfill the ambitious 
promise the states have made to their students by adopting the 
Standards: greater achievement at the college and career-ready level; 
greater depth of understanding of mathematics; and a rich classroom 
environment in which reasoning, sense-making, applications, and 
a range of mathematical practices flourish. In high school courses, 
narrowing and deepening the curriculum creates a structure that ties 
topics together. Thus, materials must focus coherently on the Widely 
Applicable Prerequisites in a way that is consistent with the progressions 
in the Standards. 


Rating this Criterion 

Non-Negotiable 1 is rated as Meets or Does Not Meet. 

To rate Non-Negotiable 1, first rate Metrics 1A-1H. Each of these 
eight metrics must be rated as Meets in order for Non-Negotiable 1 
to be rated as Meets. Rate each metric 1 A-1 H as Meets or Does Not 
Meet/Insufficient Evidence. If the evidence examined shows that the 
Criterion is met, then mark the Criterion as Meets. If the evidence 
examined shows that the Criterion is not met— or if there is insufficient 
evidence to make a determination— then mark the Criterion as Does 
Not Meet/Insufficient Evidence. Support all ratings with evidence. 


Required Materials 

• Common Core State Standards for Mathematics 
(www.corestandards.org/wp-content/uploads/Math_Standards.pdf) 

• Publishers’ Criteria for the Common Core State Standards for 
Mathematics, High School (Spring 2013) 
(http://www.corestandards.org/wp-content/uploads/Math_ 
Publishers_Criteria_HS_Spring_201 3_FINAL1 .pdf) 

• Widely Applicable Prerequisites for College and Careers (http:// 
achievethecore.org/prerequisites) 

• From the materials being evaluated: teacher guides, student texts 
and workbooks 
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Non-Negotiable 1 

Focus and Coherence 


Metric 


How to Find the Evidence 


NN Metric 1A: 

In any single course, students spend at 
least 50% of their time on Widely Applicable 
Prerequisites. 


Consider time spent on the Widely 
Applicable Prerequisites and judge 
qualitatively whether students and teachers 
using the materials as designed will devote 
the majority of time to the Widely Applicable 
Prerequisites 

For context, read Criterion #1 in the 
Publishers’ Criteria for the Common Core 
State Standards for Mathematics, High 
School (Spring 2013). 


Familiarize yourself with the Widely 
Applicable Prerequisites. 

Evaluate the table of contents and any 
pacing guides. Do not stop there; also 
evaluate units, chapters, lessons, homework 
assignments, and assessments. (Evaluate 
both student and teacher materials.) 
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Non-Negotiable 1 

Focus and Coherence 


Metric 


How to Find the Evidence 


NN Metric IB: Evaluate the table of contents and any 

Student work in Geometry involves pacing guides. Do not stop there; also 

significant work with applications/modeling evaluate units, chapters, lessons, homework 

and problems that use algebra skills. assignments, and assessments. (Evaluate 

both student and teacher materials. 

NOTE: Since Geometry contains relatively 
fewer Widely Applicable Prerequisites, this 
Criterion is important to help foster students’ 
college and career readiness. Problems that 
use algebra skills might include, for example, 
algebraic geometry problems in a coordinate 
setting, or problems of measurement 
involving unknown quantities. 
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Non-Negotiable 1 

Focus and Coherence 


Metric 


How to Find the Evidence 


NN Metric 1C: 

There are problems at a level of 
sophistication appropriate to high school 
(beyond mere review of middle school 
topics) that involve the application of 
knowledge and skills from grades 6-8. 


Evaluate lessons, chapter/unit assessments, 
and homework assignments. NOTE: 
Problems should include application of the 
following topics from grades 6-8: 

• Ratios and proportional relationships. 

• Percentage and unit conversions, e.g., 
in the context of complex measurement 
problems involving quantities with derived 
or compound units (such as mg/mL, kg/ 
m 3 , acre-feet, etc.). 

• Basic function concepts, e.g., by 
interpreting the features of a graph in the 
context of an applied problem. 

• Concepts and skills of geometric 
measurement e.g., when analyzing a 
diagram or schematic. 

• Concepts and skills of basic statistics and 
probability (see grades 6-8. SP) 

• Performing rational number arithmetic 
fluently. 

For context, read Table 1 on Page 8 of the 
Publishers’ Criteria for the Common Core 
State Standards for Mathematics, High 
School (Spring 2013). 
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Non-Negotiable 1 

Focus and Coherence 


Metric 


How to Find the Evidence 


NN Metric ID: 

Materials base courses on the content 
specified in the Standards. 


For context, read Criterion #3a in the 
Publishers’ Criteria for the Common Core 
State Standards for Mathematics, High 
School (Spring 2013). 


Evaluate the table of contents and any 
pacing guides. Do not stop there; also 
evaluate units, chapters, and lessons in both 
student and teacher materials. 
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Non-Negotiable 1 

Focus and Coherence 


Metric 


How to Find the Evidence 


NN Metric IE: Evaluate both student and teacher materials. 

Materials give all students extensive work 

with course-level problems. If the materials provide resources 

for differentiated learning, consider 
whether lower-performing students have 
opportunities to engage with course-level 
problems. Also consider whether higher- 
performing students are given opportunities 
to learn current course-level content in 
greater depth. 

For context, read Criterion #3b in the 
Publishers’ Criteria for the Common Core 
State Standards for Mathematics, High 
School (Spring 2013). 
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Non-Negotiable 1 

Focus and Coherence 


Metric 


NN Metric IF: 

Materials relate course-level concepts 
explicitly to prior knowledge from earlier 
grades or courses. The materials are 
designed so that prior knowledge becomes 
reorganized and extended to accommodate 
the new knowledge. 


How to Find the Evidence 


Evaluate student and teacher materials, 
looking for problems that involve extending 
the knowledge learned in earlier grades 
and courses. NOTE: An example of 
evaluating this Criterion might be to look at 
whether materials connect the equation of 
a circle with the distance formula and the 
Pythagorean theorem. 

For context, read Criterion #3c in the 
Publishers’ Criteria for the Common Core 
State Standards for Mathematics, High 
School (Spring 2013). 
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Non-Negotiable 1 

Focus and Coherence 


Metric 


NN Metric 1G: 

Materials include learning objectives that 
are visibly shaped by CCSSM cluster and 
domain headings. 
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How to Find the Evidence Evidence 


Select several clusters from the course being 
evaluated. Evaluate teacher and student 
materials in relation to these clusters. 

For context, read Criterion #4a in the 
Publishers’ Criteria for the Common Core 
State Standards for Mathematics, High 
School (Spring 2013). 


Rating 


□ Meets 

□ Does Not Meet / Insufficient Evidence 
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Non-Negotiable 1 

Focus and Coherence 


Metric 


How to Find the Evidence 


NN Metric 1H: 

Materials include problems and activities 
that serve to connect two or more clusters 
in a domain, or two or more domains in 
a category, or two or more categories, in 
cases where these connections are natural 
and important. 


In the course being evaluated, choose two or 
more clusters, two or more domains, or two 
or more categories for which connections 
are natural and important. 

Evaluate the units, chapters, and lessons 
that deal with the chosen topics, looking for 
problems and activities that serve to connect 
the chosen clusters or domains. NOTE: An 
example of evaluating this Criterion might 
be to look at whether materials include 
problems in which students analyze a 
situation by building a function, graphing it, 
and using it to create and solve an equation. 

For context, read Criterion #4b in the 
Publishers’ Criteria for the Common Core 
State Standards for Mathematics, High 
School (Spring 2013). 
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Non-Negotiable 1 

Focus and Coherence 

SECTION 2 

Instructional Materials Evaluation Toolkit (IMET) 

Mathematics, High School 


Non-Negotiable 1: Materials must focus coherently on the Widely Applicable Prerequisites in a way that 
is consistent with the progressions in the Standards. 


Rating for Non-Negotiable 1 

Rating 

If all metrics 1 A-1 H were rated as Meets, then rate Non-Negotiable 1 as Meets. If one or more metrics were rated as Does Not 
Meet/Insufficient Evidence, then rate Non-Negotiable 1 as Does Not Meet. Check the final rating. 

] Meets 
] Does Not Meet 

Then, briefly describe the strengths and weaknesses of these materials in light of the above Criterion. 

Strengths / Weaknesses: 


Before moving to Alignment Criterion 1, record the final Meets or Does Not Meet rating in the Evaluation Summary on Page 192. 


Now continue by evaluating Alignment Criterion 1 for Rigor and Balance. 
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Directions for Alignment Criterion 1 

Rigor and Balance 

Alignment Criterion 1: Materials must reflect the balances in the Standards and help students meet the 
Standards’ rigorous expectations. 


SECTION 2 

Instructional Materials Evaluation Toolkit (IMET) 

Mathematics, High School 


The Standards set expectations for attention to all three aspects 
of rigor: conceptual understanding, procedural skill and fluency, 
and applications. Thus, materials must reflect the balances in 
the Standards and help students meet the Standards’ rigorous 
expectations. 

Required Materials 

• Common Core State Standards for Mathematics (http:// 
corestandards.org/wp-content/uploads/Math_Standards.pdf) 

• Publishers’ Criteria for the Common Core State Standards for 
Mathematics, High School (Spring 2013) 
(http://www.corestandards.org/wp-content/uploads/Math_ 
Publishers_Criteria_HS_Spring_2013_FINAL1 .pdf) 

• Widely Applicable Prerequisites for College and Careers (http:// 
achievethecore.org/prerequisites) 

• From the materials being evaluated: teacher guides, student 
texts and workbooks 

• Choose a cluster/Standard from the Widely Applicable 
Prerequisites that is aligned to each aspect of rigor and use it 
to evaluate these metrics. It is most helpful if the same clusters 


and Standards are chosen for all of the programs being 
evaluated. (Guidance in choosing Clusters/Standards is included 
in “How to Find the Evidence” below.) 

Rating this Criterion 

Alignment Criterion 1 is rated as Meets or Does Not Meet. 

To rate Alignment Criterion 1, first rate metrics 1A, IB, and 1C. Rate 
each metric as Meets (2 points), Partially Meets (1 point), or Does Not 
Meet (0 points). For each metric, guiding questions are provided to aid 
in gathering evidence. 

Since there are three metrics, and each metric is worth up to 2 points, 
the maximum possible rating across all three metrics is 6 points. 
Ideally, aligned materials will earn all 6 points; materials are judged 
to have met Alignment Criterion 1 if the materials rate 5 or 6 points. 
This threshold recognizes that evaluators sometimes differ in how 
they assess features such as rigor and balance, while at the same 
time ensuring that no single metric can receive a rating of zero and be 
aligned to the Shifts and major features of the CCSSM. 
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SECTION 2 

Instructional Materials Evaluation Toolkit (IMET) 

Mathematics, High School 

Use the questions on this page to evaluate Metric 1A. On page 174, record evidence for each question 
and rate Metric 1A. 


Alignment Criterion 1 

Rigor and Balance 


Metric 


How to Find the Evidence Questions for Metric 


AC Metric 1A: 

The materials support the development of 
students’ conceptual understanding of key 
mathematical concepts, especially where 
called for in specific content Standards or 
cluster headings. 


Select one or more cluster(s) or Standard(s) 
from the Widely Applicable Prerequisites 
that relate specifically to conceptual 
understanding to use throughout the 
questions associated with this metric. 

NOTE: Some examples of clusters 
or Standards that call for conceptual 
understanding include: N-RN.A.1 , A-APR.B, 
A-REI.A.1 , A-REI.D.1 0, A.REI.D.1 1 , F.IF.A.1 , 
F-LE.A.1, G.SRT.A.2, G-SRT.C.6, S-ID.C.7 


For context, read Criterion #2a in the 
Publishers’ Criteria for the Common Core 
State Standards for Mathematics, High 
School (Spring 2013). 


Is conceptual understanding attended to thoroughly where the Standards set explicit 
expectations for understanding or interpreting? Evaluate lessons, chapter/unit assessments 
and homework assignments, paying attention to work aligned to Standards that explicitly call 
for understanding or interpreting. 


Do the materials feature high-quality conceptual problems and conceptual discussion 
questions? Evaluate lessons, chapter/unit assessments, and homework assignments. 
NOTE: Examples of conceptual problems might include such questions as “What is the 
maximum value of the function f(t) = 5 - 1 2 ?” or “Is 72 a polynomial? 

How about 1/2(x + 72 )+ V 2 (-x + 72 )?” 


Do the materials feature opportunities to identify correspondences across mathematical 
representations? Evaluate lessons, chapter/unit assessments and homework assignments. 
NOTE: An example of evaluating this metric might include looking at whether materials support 
students in identifying correspondences among the expression that defines a function, the 
graph that shows the relationship, and the behavior of the phenomenon being modeled (if any). 
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Alignment Criterion 1 

Rigor and Balance 


SECTION 2 

Instructional Materials Evaluation Toolkit (IMET) 

Mathematics, High School 


Metric 


Evidence 


AC Metric 1A: Is conceptual understanding attended to thoroughly where the Standards set explicit expectations for understanding or interpreting? 

The materials support the development of 

students’ conceptual understanding of key 

mathematical concepts, especially where 

called for in specific content Standards or 

cluster headings. 


Do the materials feature high-quality conceptual problems and conceptual discussion questions? 


Do the materials feature opportunities to identify correspondences across mathematical representations? 


Rating 


] Meets (2) 

] Partially Meets (1) 
] Does Not Meet (0) 
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Alignment Criterion 1 

Rigor and Balance 


SECTION 2 

Instructional Materials Evaluation Toolkit (IMET) 

Mathematics, High School 


Use the questions on this page to evaluate Metric 1 B. On page 1 76, record evidence for each question 
and rate Metric 1 B. 


Metric 


How to Find the Evidence 


Questions for Metric 


AC Metric 1 B: 

The materials are designed so that students 
attain the fluencies and procedural skills 
required by the Standards. 


Select one or more cluster(s) or Standard(s) 
from the Widely Applicable Prerequisites 
that relate specifically to fluency and 
procedural skill to use throughout the 
questions associated with this metric. NOTE: 
Some examples of Standards that call for 
procedural skill and fluency include: 
A-SSE.A.Ib, A-SSE.2, A-APR.A.1, 
A-APR.C.6, F-BF.B.3, G-GPE.B.4, 
G-GPE.B.5, G-GPE.B.7, G-CO.A.1 , 
G-SRT.B.5 

For context, read Criterion #2b in the 
Publishers’ Criteria for the Common Core 
State Standards for Mathematics, High 
School (Spring 2013). 


Is progress toward fluency and procedural skill interwoven with the student’s developing 
conceptual understanding of the skills in question? Evaluate lessons, chapter/unit 
assessments, daily routines, and homework assignments for evidence that the development of 
fluency and procedural skill is supported by conceptual understanding. 


Are purely procedural problems and exercises present that include cases in which 
opportunistic strategies are valuable and generic cases that require efficient and general 
procedures present? Evaluate lessons, chapter/unit assessments, daily routines, and 
homework assignments. NOTE: Problems in which opportunistic strategies are valuable might 
include such examples as solving x 2 + 5 = 49 + 5 or (3x - 2) 2 = 6x - 4. Generic cases that 
require efficient and general procedures might include such problems as solving c + 8 - c 2 = 
3(c - I) 2 - 5). 


Published v.2 2014 - send feedback to info@studentsachieve.net 


Reviewer Initials: 


Title of Program: 


175 


Alignment Criterion 1 

Rigor and Balance 


SECTION 2 

Instructional Materials Evaluation Toolkit (IMET) 

Mathematics, High School 


Metric 


Evidence 


AC Metric IB: Is progress toward fluency and procedural skill interwoven with the student’s developing conceptual understanding of the skills in question? 

The materials are designed so that students 
attain the fluencies and procedural skills 
required by the Standards. 


Are purely procedural problems and exercises present that include cases in which opportunistic strategies are valuable and generic cases that 
require efficient and general procedures present? 


Rating 


□ Meets (2) 

□ Partially Meets (1) 

□ Does Not Meet (0) 
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SECTION 2 

Instructional Materials Evaluation Toolkit (IMET) 

Mathematics, High School 

Use the questions on this page to evaluate Metric 1C. On page 178, record evidence for each question 
and rate Metric 1 C. 


Alignment Criterion 1 

Rigor and Balance 


Metric 


How to Find the Evidence Questions for Metric 


AC Metric 1 C: 

The materials are designed so that teachers 
and students spend sufficient time working 
with engaging applications, without 
losing focus on the Widely Applicable 
Prerequisites. 


Select one or more cluster(s) or Standard(s) 
from the Widely Applicable Prerequisites 
that relate specifically to application to 
use throughout the questions associated 
with this metric. NOTE: Some examples of 
clusters or Standards that call for application 
include: N-Q.A, A-SSE.B.3, A-REI.D.1 1, 
F-IF.B, F-IF.C.7, F-BF.A.1, G-SRT.C.8, 
S-ID.A.2, S-IC.A.1 


For context, read Criterion #2c in the 
Publishers’ Criteria for the Common Core 
State Standards for Mathematics, High 
School (Spring 2013). 


Are there single- and multi-step contextual problems, including non-routine problems, that 
develop the mathematics of the course, afford opportunities for practice, and engage students 
in problem solving? Do the problems attend thoroughly to those places in the content 
Standards where expectations for multi-step and real-world problems are explicit? Evaluate 
lessons, chapter/unit assessments, and homework assignments. 


Do application problems particularly stress applying the Widely Applicable Prerequisites? 
Evaluate lessons, chapter/unit assessments, and homework assignments. 


Are there ample opportunities for students to engage with modeling problems? Do materials 
require students to use both individual parts of the modeling cycle as well as the full modeling 
cycle? Read the pages on High School— Modeling in the Standards for Mathematics (pp. 72 
and 73). Evaluate lessons, chapter/unit assessments, and homework assignments. 
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Alignment Criterion 1 

Rigor and Balance 


SECTION 2 

Instructional Materials Evaluation Toolkit (IMET) 

Mathematics, High School 


Metric 


Evidence 


AC Metric 1C: Are there single- and multi-step contextual problems, including non-routine problems, that develop the mathematics of the course, afford 

The materials are designed so that teachers opportunities for practice, and engage students in problem solving? Do the problems attend thoroughly to those places in the content Standards 

and students spend sufficient time working where expectations for multi-step and real-world problems are explicit? 

with engaging applications, without 

losing focus on the Widely Applicable 

Prerequisites. 


Do application problems particularly stress applying the Widely Applicable Prerequisites? 


Are there ample opportunities for students to engage with modeling problems? Do materials require students to use both individual parts of the 
modeling cycle as well as the full modeling cycle? 


Rating 


] Meets (2) 

] Partially Meets (1) 
] Does Not Meet (0) 
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Alignment Criterion 1 

Rigor and Balance 

SECTION 2 

Instructional Materials Evaluation Toolkit (IMET) 

Mathematics, High School 


Alignment Criterion 1: Materials must reflect the balances in the Standards and help students meet the 
Standards’ rigorous expectations. 


Points Assigned for Alignment Criterion 1 

Rating 

Materials must earn at least 5 of 6 points to meet this Alignment Criterion. If materials earn less than 5 points, the Criterion has 
not been met. Check the final rating. 

Total (6 points possible) 

Then, briefly describe the strengths and weaknesses of these materials in light of the above Criterion. 

] Meets 
] Does Not Meet 


Strengths / Weaknesses: 


Before moving to Alignment Criterion 2, record the final Meets or Does Not Meet rating in the Evaluation Summary on Page 192. 
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Directions for Alignment Criterion 2 

Standards for Mathematical Practice 

Alignment Criterion 2: Materials must demonstrate authentic connections between content Standards 
and practice Standards. 


SECTION 2 

Instructional Materials Evaluation Toolkit (IMET) 

Mathematics, High School 


The Standards require that designers of instructional materials 
connect the mathematical practices to mathematical content in 
instruction. Thus, materials must demonstrate authentic connections 
between content Standards and practice Standards. 

Required Materials 

• Common Core State Standards for Mathematics (http:// 
corestandards.org/wp-content/uploads/Math_Standards.pdf) 

• Publishers’ Criteria for the Common Core State Standards for 
Mathematics, High School (Spring 2013) 
(http://www.corestandards.org/wp-content/uploads/Math_ 
Publishers_Criteria_HS_Spring_201 3_FINAL1 .pdf) 

• Widely Applicable Prerequisites for College and Careers (http:// 
achievethecore.org/prerequisites) 

• From the materials being evaluated: teacher guides, student 
texts and workbooks 


Rating this Criterion 

Alignment Criterion 2 is rated as Meets or Does Not Meet. 

To rate Alignment Criterion 2, first rate metrics 2A, 2B, and 2C. Rate 
each metric as Meets (2 points), Partially Meets (1 point), or Does Not 
Meet (0 points). For each metric, guiding questions are provided to aid 
in gathering evidence. 

Since there are three metrics, and each metric is worth up to 2 points, 
the maximum possible rating across all three metrics is 6 points. 
Ideally, aligned materials will earn all 6 points; materials are judged to 
have met Alignment Criterion 2 if the materials rate 5 or 6 points. This 
threshold recognizes that evaluators sometimes differ in how they 
assess features such as mathematical practices, while at the same 
time ensuring that no single metric can receive a rating of zero and be 
aligned to the Shifts and major features of the CCSSM. 
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Alignment Criterion 2 

Standards for Mathematical Practice 


Metric 


How to Find the Evidence 


AC Metric 2A: 

Materials address the practice Standards 
in such a way as to enrich the Widely 
Applicable Prerequisites; practices 
strengthen the focus of the course instead 
of detracting from it, in both teacher and 
student materials. 


Familiarize yourself with the Widely 
Applicable Prerequisites. 

Evaluate teacher and student materials for 
evidence that the mathematical practices 
support and connect to the focus of the 
course. NOTE: An example of evaluating 
this Criterion might include looking at 
whether materials use regularity in repeated 
reasoning to illuminate formal algebra as well 
as functions, particularly recursive definitions 
of functions. 

For context, read Criterion #6 in the 
Publishers’ Criteria for the Common Core 
State Standards for Mathematics, High 
School (Spring 2013). 
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Evidence 


Rating 


] Meets (2) 

] Partially Meets (1) 
] Does Not Meet (0) 
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SECTION 2 

Instructional Materials Evaluation Toolkit (IMET) 

Mathematics, High School 

Use the questions on this page to evaluate Metric 2B. On page 183, record evidence for each question 
and rate Metric 2B. 


Alignment Criterion 2 

Standards for Mathematical Practice 


Metric 

How to Find the Evidence 

Questions for Metric 

AC Metric 2B: 

Materials attend to the full meaning of each 
practice Standard. 

For context, read Criterion #7 in the 
Publishers’ Criteria for the Common Core 
State Standards for Mathematics, High 
School (Spring 2013). 

Over the course of any given year of instruction, is each mathematical practice Standard 
meaningfully present in the form of assignments, activities, or problems that stimulate students 
to develop the habits of mind described in the practice Standard? Evaluate lessons, chapter/ 
unit assessments, and homework assignments for evidence of each mathematical practice 
being meaningfully present in instruction. 


Are teacher-directed materials that explain the role of the practice Standards in the classroom 
and in students’ mathematical development included? Are alignments to practice Standards 
accurate? Evaluate teacher materials, paying attention to explanations of the role of the 
practice Standards in the classroom and in students’ mathematical development. Evaluate 
documents aligning lessons to practice Standards for accuracy. NOTE: Examples to look for 
when evaluating this metric might include the following: a highly scaffolded problem should 
not be aligned to M PI ; or a problem that directs a student to use a calculator should not be 
aligned to MP.5; or a problem about merely extending a pattern should not be aligned to MP.8. 
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Alignment Criterion 2 

Standards for Mathematical Practice 


SECTION 2 

Instructional Materials Evaluation Toolkit (IMET) 

Mathematics, High School 


Metric 


Evidence 


AC Metric 2B: Over the course of any given year of instruction, is each mathematical practice Standard meaningfully present in the form of assignments, 

Materials attend to the full meaning of each activities, or problems that stimulate students to develop the habits of mind described in the practice Standard? 

practice Standard. 


Are teacher-directed materials that explain the role of the practice Standards in the classroom and in students’ mathematical development 
included? Are alignments to practice Standards accurate? 


Rating 


] Meets (2) 

] Partially Meets (1) 
□ Does Not Meet (0) 
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SECTION 2 

Instructional Materials Evaluation Toolkit (IMET) 

Mathematics, High School 

Use the questions on this page to evaluate Metric 2C. On page 185, record evidence for each question 
and rate Metric 2C. 


Alignment Criterion 2 

Standards for Mathematical Practice 


Metric 

How to Find the Evidence 

Questions for Metric 

AC Metric 2C: 

Materials support the Standards’ emphasis 
on mathematical reasoning. 

For context, read Criterion #8 in the 
Publishers’ Criteria for the Common Core 
State Standards for Mathematics, High 
School (Spring 2013). 

Do the materials support students in constructing viable arguments and critiquing the 
arguments of others concerning course-level mathematics that is detailed in the content 
Standards? Read Standard for Mathematical Practice 3. Evaluate teacher and student 
materials to ensure that students are given opportunities to reason with grade-level 
mathematics. 


Do the materials support students in producing not only answers and solutions, but also, 
in a course-appropriate way, arguments, explanations, diagrams, mathematical models, 
etc., especially in the Widely Applicable Prerequisites? Familiarize yourself with the Widely 
Applicable Prerequisites. Evaluate teacher and student materials to understand the types of 
work students are expected to produce. 


Do materials explicitly attend to the specialized language of mathematics? Is the language 
of argument, problem solving, and mathematical explanations taught rather than assumed? 
Evaluate teacher and student materials, paying attention to how mathematical language 
is taught. NOTE: An example of evaluating this Criterion might include looking at whether 
students are supported in: basing arguments on definitions; using the method of providing a 
counterexample; or recognizing that examples alone do not establish a general statement. 
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Alignment Criterion 2 

Standards for Mathematical Practice 


SECTION 2 

Instructional Materials Evaluation Toolkit (IMET) 

Mathematics, High School 


Metric 


Evidence 


AC Metric 2C: Do the materials support students in constructing viable arguments and critiquing the arguments of others concerning course-level mathematics 

Materials support the Standards’ emphasis that is detailed in the content Standards? 
on mathematical reasoning. 


Do the materials support students in producing not only answers and solutions, but also, in a course-appropriate way, arguments, explanations, 
diagrams, mathematical models, etc., especially in the Widely Applicable Prerequisites? 


Do materials explicitly attend to the specialized language of mathematics? Is the language of argument, problem solving, and mathematical 
explanations taught rather than assumed? 


Rating 


] Meets (2) 

] Partially Meets (1) 
] Does Not Meet (0) 
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Alignment Criterion 2 

Standards for Mathematical Practice 

SECTION 2 

Instructional Materials Evaluation Toolkit (IMET) 

Mathematics, High School 


Alignment Criterion 2: Materials must demonstrate authentic connections between content Standards 
and practice Standards. 


Points Assigned for Alignment Criterion 2 

Rating 

Materials must earn at least 5 out of 6 points to meet this Alignment Criterion. If materials earn less than 5 points, the Criterion 
has not been met. Check the final rating. 

Total (6 points possible) 

Then, briefly describe the strengths and weaknesses of these materials in light of the above Criterion. 

] Meets 
] Does Not Meet 


Strengths / Weaknesses: 


Before moving to Alignment Criterion 3, record the final Meets or Does Not Meet rating in the Evaluation Summary on Page 192. 
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Directions for Alignment Criterion 3 

Access to the Standards for All Students 

Alignment Criterion 3: Materials must provide supports for English Language Learners and other special 
populations. 


SECTION 2 

Instructional Materials Evaluation Toolkit (IMET) 

Mathematics, High School 


Because Standards are for all students, alignment requires thoughtful 
support to ensure all students are able to meet the Standards. 

Thus, aligned materials must provide supports for English Language 
Learners and other special populations. 

Required Materials 

• Common Core State Standards for Mathematics (http:// 
corestandards.org/wp-content/uploads/Math_Standards.pdf) 

• Publishers’ Criteria for the Common Core State Standards for 
Mathematics, High School (Spring 2013) 
(http://www.corestandards.org/wp-content/uploads/Math 
Publishers_Criteria_HS_Spring_201 3_FINAL1 .pdf) 

• From the materials being evaluated: teacher guides, student 
texts and workbooks 


each metric as Meets (2 points), Partially Meets (1 point), or Does Not 
Meet (0 points). 

Since there are three metrics, and each metric is worth up to 2 points, 
the maximum possible rating across all three metrics is 6 points. 
Ideally, aligned materials will earn all 6 points; materials are judged to 
have met Alignment Criterion 3 if the materials rate 5 or 6 points. This 
threshold recognizes that evaluators sometimes differ in how they 
assess features such as support for special population, while at the 
same time ensuring that no single metric can receive a rating of zero 
and be aligned to the Shifts and major features of the CCSSM. 


Rating this Criterion 

Alignment Criterion 3 is rated as Meets or Does Not Meet. 

To rate Alignment Criterion 3, first rate metrics 3A, 3B, and 3C. Rate 
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Alignment Criterion 3 

Access to the Standards for All Students 


Metric 


How to Find the Evidence 


AC Metric 3A: 

Support for English Language Learners 
and other special populations is thoughtful 
and helps those students meet the same 
Standards as all other students. The 
language in which problems are posed is 
carefully considered. 


Evaluate teacher and student materials, 
paying attention to supports offered for 
special populations. 
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Evidence 


Rating 


□ Meets (2) 

□ Partially Meets (1) 

□ Does Not Meet (0) 
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Alignment Criterion 3 

Access to the Standards for All Students 


SECTION 2 

Instructional Materials Evaluation Toolkit (IMET) 

Mathematics, High School 


Metric 


How to Find the Evidence Evidence 


AC Metric 3B: 

Materials provide appropriate level and type 
of scaffolding, differentiation, intervention, 
and support for a broad range of learners 
with gradual removal of supports, when 
needed, to allow students to demonstrate 
their mathematical understanding 
independently. 


Evaluate teacher and student materials, 
paying attention to whether materials provide 
differentiation that will lead all learners to 
engage with on-grade-level content. 


Rating 


] Meets (2) 

] Partially Meets (1) 
] Does Not Meet (0) 
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Alignment Criterion 3 

Access to the Standards for All Students 


Metric 

How to Find the Evidence 

AC Metric 3C: 

Design of lessons recommends and 
facilitates a mix of instructional approaches 
for a variety of learners such as using 
multiple representations (e.g., including 
models, using a range of questions, 
checking for understanding, flexible 
grouping, pair-share). 

Evaluate teacher materials, noting 
instructional approaches suggested for 
whole class and differentiated lessons and 
activities. 


Published v.2 201 4 - send feedback to info@studentsachieve.net Reviewer Initials: 


SECTION 2 

Instructional Materials Evaluation Toolkit (IMET) 

Mathematics, High School 


Evidence 


Rating 


□ Meets (2) 

□ Partially Meets (1) 

□ Does Not Meet (0) 
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Alignment Criterion 3 

Access to the Standards for All Students 

SECTION 2 

Instructional Materials Evaluation Toolkit (IMET) 

Mathematics, High School 


Alignment Criterion 3: Materials must provide supports for English Language Learners and other special 
populations. 


Points Assigned for Alignment Criterion 3 

Rating 

Materials must earn at least 5 out of 6 points to meet this Alignment Criterion. If materials earn less than 5 points, the Criterion 
has not been met. Check the final rating. 

Total (6 points possible) 

Then, briefly describe the strengths and weaknesses of these materials in light of the above Criterion. 

] Meets 
] Does Not Meet 


Strengths / Weaknesses: 


Move to the Evaluation Summary on the following page to record the final Meets or Does Not Meet rating. 
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SECTION 2 

Instructional Materials Evaluation Toolkit (IMET) 

Mathematics, High School 


Program: 

Publisher: 

Date of Publication: 


Name of Evaluator(s): 

Date of Evaluation: 

Signature of Each Evaluator(s): 


Non-Negotiable Criteria 


The Non-Negotiable Criterion must be Met. 

Non-Negotiable 1: 

Focus and Coherence 

Meets 

Does Not Meet 


Alignment Criteria 


Each Alignment must be met with a sufficient number of points in order for Alignment Criteria to be labeled as “Meets” overall. The more points 
the materials receive on the Alignment Criteria, the better they are aligned. 

Alignment Criterion 1: 
Rigor and Balance 

Alignment Criterion 2: 

Standards for Mathematical Practice 

Alignment Criterion 3: 

Access to Standards for All Learners 

Points: of 6 possible. 

(Materials must receive at least 5 of 6 points 
to align.) 

Points: of 6 possible. 

(Materials must receive at least 5 of 6 points 
to align.) 

Points: of 6 possible. 

(Materials must receive at least 5 of 6 points 
to align.) 

] Meets 

] Meets 

] Meets 

] Does Not Meet 

] Does Not Meet 

] Does Not Meet 


Alignment Criteria Overall 
□ Meets 

] Does Not Meet 
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IMET Evaluation Summary 2 of 2 


Program: 

Publisher: 

Date of Publication: 


Summary 

If the materials meet the Non-Negotiable Criterion and each Alignment Criterion, they are 
aligned to the Shifts and major features of the CCSS. 

Do the materials meet every Non-Negotiable and Alignment Criteria? 

□ Yes 

□ No 


What are the specific areas of strength and weakness based on this evaluation? 

Publishers or others modifying or developing assessments can use this information to make 
improvements and/or to remedy gaps in the alignment of assessment materials. 
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Indicators of Quality 


SECTION 2 

Instructional Materials Evaluation Toolkit (IMET) 

Mathematics, High School 


Once an evaluation for alignment to the Shifts and major features of the CCSS has been conducted using Sections 1 -3, it’s important to evaluate 
for overall quality and best practices. A starting list of Indicators of Quality are suggested below. States, districts and others evaluating instructional 
materials are encouraged to add to this list to ensure materials reflect local contexts. For background information on some of the Indicators of Quality in 
this section, refer to pp.16-18 in the Publishers’ Criteria for the Common Core State Standards for Mathematics, High School (Spring 2013). 


Indicators 


Evidence 


Rating (Y/N) 


1 . Lessons are thoughtfully structured and support the 
teacher in leading the class through the learning paths at 
hand, with active participation by all students in their own 
learning and in the learning of their classmates. 

2. The underlying design of the materials includes both 
problems and exercises. (In solving problems, students 
learn new mathematics, whereas in working exercises, 
students apply what they have already learned to build 
mastery.) Each problem or exercise has a purpose. 

NOTE: This Criterion does not require that the problems 
and exercises be labeled as such. 


3. Design of assignments is not haphazard: exercises 
are given in intentional sequences in order to strengthen 
students’ mathematical understanding. 
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Indicators of Quality 


Indicators 


4. There are separate teacher materials that support and 
reward teacher study including, but not limited to: 
discussion of the mathematics of the units and the 
mathematical point of each lesson as it relates to the 
organizing concepts of the unit, discussion on student 
ways of thinking and anticipating a variety of students 
responses, guidance on lesson flow, guidance on 
questions that prompt students thinking, and discussion 
of desired mathematical behaviors being elicited 
among students. 

5. Manipulatives suggested in the materials are faithful 
representations of the mathematical objects they represent 
and are connected to written methods. 


6. Materials include a variety of curriculum-embedded 
assessments. Examples include pre-, formative, 
summative, and self-assessment resources. 

7. Assessments contain aligned rubrics, answer keys, 

and scoring guidelines that provide sufficient guidance for 
interpreting student performance. 

8. Materials assess student proficiency using methods that 
are accessible and unbiased, including the use of course- 
level language in student prompts. 
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Rating (Y/N) 
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Indicators of Quality 


Indicators 


Evidence 


9. Materials are carefully evaluated by qualified individuals, 
whose names are listed, in an effort to ensure freedom 
from mathematical errors and course-level 
appropriateness. 


10. The visual design supports students in engaging 

thoughtfully with the subject. Navigation through the text 
is clear. 
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Section 3 


EQuIP 


202 Mathematics, Grades K-12 Rubric 

204 ELA/Literacy, Grades K-2 Rubric 

206 ELA/Literacy, Grades 3-5 & 6-12 Rubric 
Student Work Protocol 
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EQuIP Rubric 


Educators Evaluating Quality Instructional Products (EQuIP) is a 
collaborative of states working with Achieve to increase the 
supply of quality instructional materials that are aligned to the 
CCSS and build the capacity of educators to evaluate and 
improve the quality of instructional materials for use in their 
classrooms and schools. The EQuIP Rubrics are a set of quality 
review tools to evaluate the alignment of lessons, units and 
modules to the CCSS. There are three EQuIP Rubrics, one each 
for Mathematics, K-2 English Language Arts/Literacy, and a 
combined rubric for 3-5 English Language Arts/Literacy and 6-12 
English Language Arts. EQuIP builds on a collaborative effort of 
education leaders from Massachusetts, New York and Rhode 
Island that Achieve facilitated. 

The EQuIP Rubrics should be used for: 

• Guiding the development of lessons and units; 

• Evaluating existing lessons and units to identify 
improvements needed to align with the CCSS; 

• Building the capacity of teachers to gain a deeper 
understanding of the instructional demands of the CCSS; 
and, 

• Informing publishers of the criteria that will be applied in 
the evaluation of proposals and final products. 

a) Where to find online: 

To view and download the rubrics and related training 
materials, please visit: www.achieve.org/equip 

b) Who uses: 

The EQuIP Rubrics are designed for use by educators and 
administrators responsible for developing, reviewing or 
making determinations about materials for use in classrooms. 
This includes classroom teachers, instructional coaches, 
instructional leaders and administrators at the school, district 
or state level. 


c) Target materials: 

The EQuIP Rubrics are designed to evaluate lessons that 
include instructional activities and assessments aligned to the 
CCSS that may extend over a few class periods or days as well 
as units that include integrated and focused lessons aligned to 
the CCSS that extend over a period of several weeks. The 
rubrics are not designed to evaluate a single task or activity or 
portion of a lesson. The rubrics intentionally do not require a 
specific template for lesson or unit design. 

d) How to use: 

The EQuIP Rubrics can guide the development of lessons and 
units as well as examine and evaluate existing lessons and 
units to identify improvements necessary to align with the 
CCSS. They can be used by individuals or groups, integrated 
into formal review panels/processes and professional learning 
communities, and/or used more informally to guide 
discussions and decision making. 

The criteria in the EQuIP Rubrics are separated into four 
dimensions: Alignment to the Depth of the CCSS, Key Shifts in 
the CCSS, Instructional Supports, and Assessment. 

Getting Started 

It is helpful to first orient yourself to all of the materials 
necessary to complete an EQuIP Quality Review. These 
materials will include the lesson or unit being evaluated, 
including any texts or rubrics utilized by teachers or students, 
a copy of the Common Core State Standards, and an EQuIP 
Rubric Feedback form. As this is a collegial process, reviewers 
working together should introduce themselves to one 
another. 
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Principles & Agreements 

Adhering to the EQuIP principles and agreements 
creates a collegial environment in which reviewers can 
develop criterion-based suggestions for improving the 
alignment and quality of instructional materials. It is vital 
to the process to create a collegial environment, 
recognizing both that it is challenging to create high- 
quality instructional materials and that it is necessary to 
receive quality feedback in order to improve these 
materials. 

1. CCSS: Before beginning a review, all members are 
confident in their knowledge of the CCSS. 

2. Inquiry: Review processes emphasize inquiry and are 
organized in steps around a set of guiding questions. 

3. Respect & Commitment: Each member of a review 
team is respected as a valued colleague and 
contributor who makes a commitment to the EQuIP 
process. 

4. Criteria & Evidence: All observations, judgments, 
discussions, and recommendations are criterion- and 
evidence-based. 

5. Constructive: Lessons/units to be reviewed are seen as 
"works in progress." Reviewers are respectful of 
contributors' work and make constructive observations 
and suggestions based on evidence from the work. 

6. Individual to Collective: Each member of a review 
team independently records his/her observations prior 
to discussion. Discussions focus on understanding all 
reviewers' interpretations of the criteria and the 
evidence they have found. 

7. Understanding & Agreement: The goal of the process 
is to compare and eventually calibrate judgments to 


move toward agreement about quality with respect to 
the CCSS. 

Giving Feedback 

The goal of EQuIP is to support the education 
community in the development of exemplary 
curriculum; constructive feedback and comments are 
fundamental to improving the materials. Reviewers 
should consider their audience and purposes when 
crafting the tone and content of their comments. It is 
critical to read every page of a lesson or unit. Writing 
effective feedback is vital to the EQuIP Quality Review 
Process. Below are the four qualities of effective 
feedback. 

• Criteria-based: Written comments are based on the 
criteria used for review in each dimension. No 
extraneous or personal comments are included. 

• Evidence Cited: Written comments suggest that the 
reviewer looked for evidence in the lesson or unit 
that address each criterion of a given dimension. 
Examples are provided that cite where and how the 
criteria are met or not met. 

• Improvement Suggested: When improvements are 
identified to meet criteria or strengthen the lesson or 
unit, specific information is provided about how and 
where such improvement should be added to the 
material. 

• Clear Communication: Written comments are 
constructed in a manner keeping with basic 
grammar, spelling, sentence structure and 
conventions. 
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EQuIP Quality Review Steps 
Step 1. Review Materials 

Record the grade and title of the lesson/unit on the 
Quality Review Rubric PDF. 

Scan to see what the lesson/unit contains and how it is 
organized. 

Read key materials related to instruction, assessment 
and teacher guidance. 

In ELA, study and measure the text(s) that serves as 
the centerpiece for the lesson/unit, analyzing text 
complexity, quality, scope, and relationship to 
instruction. 

In math, study and work the task that serves as the 
centerpiece for the lesson/unit, analyzing the content 
and mathematics practices the tasks require. 

Guidance for facilitators: During Step 1, reviewers should 
not try to read every word of the lesson/unit from start 
to finish, but rather get an overall sense of what is 
contained in the instructional materials. It is particularly 
important that reviewers read the text(s) and look for 
the quantitative and qualitative measures of text(s) 
complexity or study and work the tasks that are central 
to instruction. 

Explain that reviewers should not use the EQuIP Rubric 
during Step 1. Reviewers will have ample opportunity to 
think deeply about the criteria in each dimension during 
subsequent steps of the review process. 

If the materials are not clearly labeled, it is necessary to 
determine if the materials should be reviewed as a 
lesson or unit. EQuIP generally defines a lesson as one to 
ten days of instruction and a unit as two to ten weeks of 


instruction; however, reviewers should use their 
professional judgment when making this determination. 
Please consider if it would be appropriate to apply the 
additional criteria given the purpose of instruction and 
the standard(s) the materials target. 

Step 2. Apply Criteria in Dimension I: Alignment to the 
Depth of the CCSS 

Identify the grade-level CCSS that the lesson/unit 
targets. 

Closely examine the materials through the "lens" of 
each criterion. 

Indicate each criterion for which clear and substantial 
evidence is found. 

Record evidence and specific improvements needed to 
meet criteria or strengthen alignment. 

Compare observations and suggestions for 
improvement. 


Guidance for facilitators: The criteria may only be 
checked if there is clear and substantial evidence of the 
criterion (there are no "half-checks"). There may be 
instances when reviewers find clear and substantial 
evidence of a criterion and there are still constructive 
suggestions that can be made. In such cases, reviewers 
may provide feedback related to criteria that have been 
checked. 

Step 3. Apply Criteria in Dimensions II— IV 

Examine the lesson/unit through the "lens" of each 
criterion. 

Indicate each criterion met and record observations 
and feedback. 


Step 4. Apply an Overall Rating and Provide Summary 
Comments 

Individually review comments for Dimensions I— IV, 
adding/clarifying comments as needed. 

Individually write summary comments on the Quality 
Review Rubric PDF. 

Guidance for facilitators: If reviewers are going to stop 
review at Dimension I, take time to make sure the 
criteria are absent. 

There may be instances when reviewers find clear and 
substantial evidence of a criterion and there are still 
constructive suggestions that can be made. In such 
cases, reviewers should provide feedback related to 
criteria that have been checked. 


It's acceptable to give a "3" rating without having all of 
the criteria checked within a dimension. It's about 
supporting with evidence regardless of the rating a 
reviewer gives. If recommendations for improvement 
are too significant, then the rating should be less than a 
"3." There should be a relationship between the number 
of checks and the overall rating. There shouldn't be huge 
misalignment, but it comes down to professional 
judgment. Reviewers should stand back and look at the 
review in its totality. 

Step 5. Compare Overall Ratings and Determine Next 
Steps 

• Note the evidence cited to arrive at summary 
comments and similarities and differences among 
reviewers. Recommend next steps for the lesson/unit 
and provide recommendations for improvement to 
developers/teachers. 
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EQuIP Rubric for Lessons & Units: Mathematics 



Quality Instructional Products 


Grade: 


Mathematics Lesson/Unit Title: 


Overall Rating: « 

Achieve 


1. Alignment to the Depth 
of the CCSS 

II. Key Shifts in the CCSS 

III. Instructional Supports 

IV. Assessment 

The lesson/unit aligns with the 
letter and spirit of the CCSS: 

o Targets a set of grade- 
level CCSS mathematics 
standard(s) to the full 
depth of the standards for 
teaching and learning. 

o Standards for 

Mathematical Practice 
that are central to the 
lesson are identified, 
handled in a grade- 
appropriate way, and well 
connected to the content 
being addressed, 
o Presents a balance of 
mathematical procedures 
and deeper conceptual 
understanding inherent in 
the CCSS. 

The lesson/unit reflects evidence of key shifts that are reflected in the 
CCSS: 

o Focus: Lessons and units targeting the major work of the grade 
provide an especially in-depth treatment, with especially high 
expectations. Lessons and units targeting supporting work of the 
grade have visible connection to the major work of the grade 
and are sufficiently brief. Lessons and units do not hold students 
responsible for material from later grades, 
o Coherence: The content develops through reasoning about the 
new concepts on the basis of previous understandings. Where 
appropriate, provides opportunities for students to connect 
knowledge and skills within or across clusters, domains and 
learning progressions. 

o Rigor: Requires students to engage with and demonstrate 
challenging mathematics with appropriate balance among the 
following: 

- Application: Provides opportunities for students to 
independently apply mathematical concepts in real-world 
situations and solve challenging problems with persistence, 
choosing and applying an appropriate model or strategy to 
new situations. 

- Conceptual Understanding: Develops students' conceptual 
understanding through tasks, brief problems, questions, 
multiple representations and opportunities for students to 
write and speak about their understanding. 

- Procedural Skill and Fluency: Expects, supports and provides 
guidelines for procedural skill and fluency with core 
calculations and mathematical procedures (when called for in 
the standards for the grade) to be performed quickly and 
accurately. 

The lesson/unit is responsive to varied student learning needs: 
o Includes clear and sufficient guidance to support teaching and learning of the 
targeted standards, including, when appropriate, the use of technology and 
media. 

o Uses and encourages precise and accurate mathematics, academic language, 
terminology and concrete or abstract representations (e.g., pictures, symbols, 
expressions, equations, graphics, models) in the discipline, 
o Engages students in productive struggle through relevant, thought-provoking 
questions, problems and tasks that stimulate interest and elicit mathematical 
thinking. 

o Addresses instructional expectations and is easy to understand and use. 
o Provides appropriate level and type of scaffolding, differentiation, intervention 
and support for a broad range of learners. 

Supports diverse cultural and linguistic backgrounds, interests and styles. 
Provides extra supports for students working below grade level. 

Provides extensions for students with high interest or working above 
grade level. 

A unit or longer lesson should: 

o Recommend and facilitate a mix of instructional approaches for a variety of 
learners such as using multiple representations (e.g., including models, using a 
range of questions, checking for understanding, flexible grouping, pair-share), 
o Gradually remove supports, requiring students to demonstrate their 
mathematical understanding independently, 
o Demonstrate an effective sequence and a progression of learning where the 
concepts or skills advance and deepen over time, 
o Expect, support and provide guidelines for procedural skill and fluency with 
core calculations and mathematical procedures (when called for in the 
standards for the grade) to be performed quickly and accurately. 

The lesson/unit regularly assesses 
whether students are mastering 
standards-based content and 
skills: 

o Is designed to elicit direct, 
observable evidence of the 
degree to which a student can 
independently demonstrate 
the targeted CCSS. 
o Assesses student proficiency 
using methods that are 
accessible and unbiased, 
including the use of grade- 
level language in student 
prompts. 

o Includes aligned rubrics, 
answer keys and scoring 
guidelines that provide 
sufficient guidance for 
interpreting student 
performance. 

A unit or longer lesson should: 
o Use varied modes of 
curriculum-embedded 
assessments that may include 
pre-, formative, summative 
and self-assessment 
measures. 

Rating: 3 2 10 

Rating: 3 2 10 

Rating: 3 2 10 

Rating: 3 2 10 


^creative 
^commons 


The EQuIP rubric is derived from the Tri-Stote Rubric and the collaborative development process led by Massachusetts, New York, and Rhode Island and facilitated by Achieve. 

This version of the EQuIP rubric is current as of 06-15-13. 

View Creative Commons Attribution 3.0 Unported License at http://creativecommons. org/licenses/by/3. 0/ . Educators may use or adapt. If modified, please attribute EQuIP and re-title. 
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EQuIP Rubric for Lessons & Units: Mathematics 


Directions: The Quality Review Rubric provides criteria to determine the quality and alignment of lessons and units to the Common Core State Standards (CCSS) in order to: (1) Identify exemplars/ models for teachers' use within and across 
states; (2) provide constructive criteria-based feedback to developers; and (3) review existing instructional materials to determine what revisions are needed. 

Step 1 - Review Materials 

■ Record the grade and title of the lesson/unit on the recording form. 

■ Scan to see what the lesson/unit contains and how it is organized. 

■ Read key materials related to instruction, assessment and teacher guidance. 

■ Study and work the task that serves as the centerpiece for the lesson/unit, analyzing the content and mathematical practices the tasks require. 

Step 2 - Apply Criteria in Dimension I: Alignment 

■ Identify the grade-level CCSS that the lesson/unit targets. 

■ Closely examine the materials through the "lens" of each criterion. 

■ Individually check each criterion for which clear and substantial evidence is found. 

■ Identify and record input on specific improvements that might be made to meet criteria or strengthen alignment. 

■ Enter your rating 0 - 3 for Dimension I: Alignment. 

Note: Dimension I is non-negotiable. In order for the review to continue, a rating of 2 or 3 is reguired. If the review is discontinued, consider general feedback that might be given to developers/teachers regarding next steps. 

Step 3 - Apply Criteria in Dimensions II - IV 

■ Closely examine the lesson/unit through the "lens" of each criterion. 

■ Record comments on criteria met, improvements needed and then rate 0-3. 

When working in a group, individuals may choose to compare ratings after each dimension or delay conversation until each person has rated and recorded their input for the remaining Dimensions II - IV. 

Step 4 - Apply an Overall Rating and Provide Summary Comments 

■ Review ratings for Dimensions I - IV adding/clarifying comments as needed. 

■ Write summary comments for your overall rating on your recording sheet. 

■ Total dimension ratings and record overall rating E, E/I, R, N - adjust as necessary. 

If working in a group, individuals should record their overall rating prior to conversation. 

Step 5 - Compare Overall Ratings and Determine Next Steps 

■ Note the evidence cited to arrive at final ratings, summary comments and similarities and differences among raters. Recommend next steps for the lesson/unit and provide recommendations for improvement and/or ratings to 
developers/teachers. 

Additional Guidance on Dimension II: Shifts - When considering Focus it is important that lessons or units targeting additional and supporting clusters are sufficiently brief - this ensures that students will spend the strong majority of the 
year on major work of the grade. See the K-8 Publishers Criteria for the Common Core State Standards in Mathematics, particularly pages 8-9 for further information on the focus criterion with respect to major work of the grade at 
www.corestandards.org/assets/Math Publishers Criteria K-8 Summer%202012 FINALpdf. With respect to Coherence it is important that the learning objectives are linked to CCSS cluster headings (see www.corestandards.org/Math ). 

Rating Scales 

Rating for Dimension I: Alignment is non-negotiable and requires a rating of 2 or 3. If rating is 0 or 1 then the review does not continue. 


Rating Scale for Dimensions I, II, III, IV: 

3: Meets most to all of the criteria in the dimension 
2: Meets many of the criteria in the dimension 


Overall Rating for the Lesson/Unit: 

E: Exemplar - Aligned and meets most to all of the criteria in dimensions II, III, IV (total 11 - 12) 

E/I: Exemplar //Improved - Aligned and needs some improvement in one or more dimensions (total 8 - 10) 


1: Meets some of the criteria in the dimension 
0: Does not meet the criteria in the dimension 


R: Revision Needed - Aligned partially and needs significant revision in one or more dimensions (total 3-7) 
N: Not Ready to Review - Not aligned and does not meet criteria (total 0-2) 


Descriptors for Dimensions I, II, III, IV: 

3: Exemplifies CCSS Quality - meets the standard described by criteria in the dimension, as explained in 
criterion-based observations. 

2: Approaching CCSS Quality - meets many criteria but will benefit from revision in others, as suggested in 
criterion-based observations. 


Descriptor for Overall Ratings: 

E: Exemplifies CCSS Quality - Aligned and exemplifies the quality standard and exemplifies most of the criteria across Dimensions II, III, IV of 
the rubric. 

E/I: Approaching CCSS Quality - Aligned and exemplifies the quality standard in some dimensions but will benefit from some revision in 
others. 


1: Developing toward CCSS Quality - needs significant revision, as suggested in criterion-based 
observations. 

0: Not representing CCSS Quality - does not address the criteria in the dimension. 


R: Developing toward CCSS Quality - Aligned partially and approaches the quality standard in some dimensions and needs significant revision 
in others. 

N: Not representing CCSS Quality - Not aligned and does not address criteria. 
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Quality Instructional Products 


EQuIP Rubric for Lessons & Units: ELA/Literacy Grades K-2 
Grade: Literacy Lesson/Unit Title: 


Overall Rating: 



Achieve 


1. Alignment to the Depth of the CCSS 

II. Key Shifts in the CCSS 

III. Instructional Supports 

IV. Assessment 

The lesson/unit aligns with the letter and spirit of the 

CCSS: 

o Targets a set of K-2 ELA/Literacy CCSS for 
teaching and learning. 

o Includes a clear and explicit purpose for 
instruction. 

o Selects quality text(s) that align with the 

requirements outlined in the standards, presents 
characteristics similar to CCSS K-2 exemplars 
(Appendix B), and are of sufficient scope for the 
stated purpose. 

o Provides opportunities for students to present 
ideas and information through writing and/or 
drawing and speaking experiences. 

A unit or longer lesson should: 

o Emphasize the explicit, systematic development of 
foundational literacy skills (concepts of print, 
phonological awareness, the alphabetic principle, 
high frequency sight words, and phonics). 

o Regularly include specific fluency-building 

techniques supported by research (e.g., monitored 
partner reading, choral reading, repeated readings 
with text, following along in the text when teacher 
or other fluent reader is reading aloud, short 
timed practice that is slightly challenging to the 
reader). 

o Integrate reading, writing, speaking and listening 
so that students apply and synthesize advancing 
literacy skills. 

o Build students' content knowledge in social 
studies, the arts, science or technical subjects 
through a coherent sequence of texts and series of 
questions that build knowledge within a topic. 

The lesson/unit addresses key shifts in the CCSS: 
o Reading Text Closely: Makes reading text(s) 
closely (including read alouds) a central focus of 
instruction and includes regular opportunities 
for students to ask and answer text-dependent 
questions. 

o Text-Based Evidence: Facilitates rich text-based 
discussions and writing through specific, 
thought-provoking questions about common 
texts (including read alouds and, when 
applicable, illustrations, audio/video and other 
media). 

o Academic Vocabulary: Focuses on explicitly 
building students' academic vocabulary and 
concepts of syntax throughout instruction. 

A unit or longer lesson should: 
o Grade-Level Reading: Include a progression of 
texts as students learn to read (e.g., additional 
phonic patterns are introduced, increasing 
sentence length). Provides text-centered 
learning that is sequenced, scaffolded and 
supported to advance students toward 
independent grade-level reading, 
o Balance of Texts: Focus instruction equally on 
literary and informational texts as stipulated in 
the CCSS (p.5) and indicated by instructional 
time (may be more applicable across a year or 
several units). 

o Balance of Writing: Include prominent and 
varied writing opportunities for students that 
balance communicating thinking and answering 
questions with self-expression and exploration. 

The lesson/unit is responsive to varied student learning needs: 
o Cultivates student interest and engagement in reading, writing and speaking 
about texts. 

o Addresses instructional expectations and is easy to understand and use for 
teachers (e.g., clear directions, sample proficient student responses, sections 
that build teacher understanding of the whys and how of the material), 
o Integrates targeted instruction in multiple areas such as grammar and syntax, 
writing strategies, discussion rules and aspects of foundational reading, 
o Provides substantial materials to support students who need more time and 
attention to achieve automaticity with decoding, phonemic awareness, fluency 
and/or vocabulary acquisition. 

o Provides all students (including emergent and beginning readers) with extensive 
opportunities to engage with grade-level texts and read alouds that are at high 
levels of complexity including appropriate scaffolding so that students directly 
experience the complexity of text. 

o Focuses on sections of rich text(s) (including read alouds) that present the 
greatest challenge; provides discussion questions and other supports to 
promote student engagement, understanding and progress toward 
independence. 

o Integrates appropriate, extensive and easily implemented supports for students 
who are ELL, have disabilities and/or read or write below grade level, 
o Provides extensions and/or more advanced text for students who read or write 
above grade level. 

A unit or longer lesson should: 

o Include a progression of learning where concepts, knowledge and skills advance 
and deepen over time (may be more applicable across the year or several units), 
o Gradually remove supports, allowing students to demonstrate their independent 
capacities (may be more applicable across the year or several units), 
o Provide for authentic learning, application of literacy skills and/or student- 
directed inquiry. 

o Indicate how students are accountable for independent engaged reading based 
on student choice and interest to build stamina, confidence and motivation 
(may be more applicable across the year or several units), 
o Use technology and media to deepen learning and draw attention to evidence 
and texts as appropriate. 

The lesson/unit regularly 
assesses whether students 
are developing standards- 
based skills: 

o Elicits direct, observable 
evidence of the degree to 
which a student can 
independently 
demonstrate foundational 
skills and targeted grade 
level literacy CCSS (e.g., 
reading, writing, speaking 
and listening and/or 
language), 
o Assesses student 

proficiency using methods 
that are unbiased and 
accessible to all students, 
o Includes aligned rubrics or 
assessment guidelines that 
provide sufficient guidance 
for interpreting student 
performance and 
responding to areas where 
students are not yet 
meeting standards. 

A unit or longer lesson should: 
o Use varied modes of 
assessment, including a 
range of pre-, formative, 
summative and self- 
assessment measures. 

Rating: 3 2 10 

Rating: 3 2 10 

Rating: 3 2 10 

Rating: 3 2 10 


Oicreative 
^commons 


The EQuIP rubric is derived from the Tri-State Rubric and the collaborative development process led by Massachusetts, New York, and Rhode Island and facilitated by Achieve. 

This version of the EQuIP rubric is current as of 06-24-13. 
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EQuIP Rubric for Lessons & Units: ELA/Literacy Grades K-2 

Directions: The Quality Review Rubric provides criteria to determine the quality and alignment of lessons and units to the Common Core State Standards (CCSS) in order to: (1) Identify exemplars/ models for teachers' use 
within and across states; (2) provide constructive criteria-based feedback to developers; and (3) review existing instructional materials to determine what revisions are needed. 

Step 1 - Review Materials 

■ Record the grade and title of the lesson/unit on the recording form. 

■ Scan to see what the lesson/unit contains and how it is organized. 

■ Read key materials related to instruction, assessment and teacher guidance. 

■ Study and measure the text(s) that serves as the centerpiece for the lesson/unit, analyzing text complexity, quality, scope, and relationship to instruction. 

Step 2 - Apply Criteria in Dimension I: Alignment 

■ Identify the grade-level CCSS that the lesson/unit targets. 

■ Closely examine the materials through the "lens" of each criterion. 

■ Individually check each criterion for which clear and substantial evidence is found. 

■ Identify and record input on specific improvements that might be made to meet criteria or strengthen alignment. 

■ Enter your rating 0 - 3 for Dimension I: Alignment 

Note: Dimension I is non-negotiable. In order for the review to continue , a rating of 2 or 3 is required. If the review is discontinued, consider general feedback that might be given to developers/teachers regarding next steps. 

Step 3 - Apply Criteria in Dimensions II - IV 

■ Closely examine the lesson/unit through the "lens" of each criterion. 

■ Record comments on criteria met, improvements needed and then rate 0-3. 

When working in a group, individuals may choose to compare ratings after each dimension or delay conversation until each person has rated and recorded their input for the remaining Dimensions II - IV. 

Step 4 - Apply an Overall Rating and Provide Summary Comments 

■ Review ratings for Dimensions I - IV adding/clarifying comments as needed. 

■ Write summary comments for your overall rating on your recording sheet. 

■ Total dimension ratings and record overall rating E, E/I, R, N - adjust as necessary. 

If working in a group, individuals should record their overall rating prior to conversation. 

Step 5 - Compare Overall Ratings and Determine Next Steps 

■ Note the evidence cited to arrive at final ratings, summary comments and similarities and differences among raters. Recommend next steps for the lesson/unit and provide recommendations for improvement and/or 
ratings to developers/teachers. 

Additional Guidance for ELA/Literacy - When selecting text(s) that measure within the grade-level or text complexity band and are of sufficient quality and scope for the stated purpose, see The Common Core State Standards 
in English Language Arts/Literacy at www.corestandards.org/ELA-Literacy; and the Supplement for Appendix A: New Research on Text Complexity as well as Quantitative and Qualitative Measures at 
www.achievethecore.org/steal-these-tools/text-complexity . See The Publishers' Criteria for Grades K-2 and the same for Grades 3-12 at www.achievethecore.org/steal-these-tools . 

Rating Scales 

Note: Rating for Dimension I: Alignment is non-negotiable and requires a rating of 2 or 3. If rating is 0 or 1 then the review does not continue. 

Rating Scale for Dimensions I, II, III, IV: Overall Rating for the Lesson/Unit: 

3: Meets most to all of the criteria in the dimension E: Exemplar - Aligned and meets most to all of the criteria in dimensions II, III, IV (total 11 - 12) 

2: Meets many of the criteria in the dimension E/I: Exemplar if Improved - Aligned and needs some improvement in one or more dimensions (total 8 - 10) 

1: Meets some of the criteria in the dimension R: Revision Needed - Aligned partially and needs significant revision in one or more dimensions (total 3-7) 

0: Does not meet the criteria in the dimension N: Not Ready to Review - Not aligned and does not meet criteria (total 0-2) 

Descriptors for Dimensions I, II, III, IV: Descriptors for Overall Rating: 

3: Exemplifies CCSS Quality - meets the standard described by criteria in the dimension, as explained in E: Exemplifies CCSS Quality - Aligned and exemplifies the quality standard and exemplifies most of the criteria across Dimensions II, III, IV of 
criterion-based observations. the rubric. 

2: Approaching CCSS Quality - meets many criteria but will benefit from revision in others, as suggested in E/I: Approaching CCSS Quality - Aligned and exemplifies the quality standard in some dimensions but will benefit from some revision in 
criterion-based observations. others. 

1: Developing toward CCSS Quality - needs significant revision, as suggested in criterion-based R: Developing toward CCSS Quality - Aligned partially and approaches the quality standard in some dimensions and needs significant revision 

observations. in others. 

0: Not representing CCSS Quality - does not address the criteria in the dimension. | N: Not representing CCSS Quality - Not aligned and does not address criteria. 
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EQuIP Rubric for Lessons & Units: ELA/Literacy (Grades 3-5) and ELA (Grades 6-12) 
Literacy Lesson/Unit Title: 


Overall Rating: 



Achieve 


1. Alignment to the Depth of the CCSS 

II. Key Shifts in the CCSS 

III. Instructional Supports 

IV. Assessment 

The lesson/unit aligns with the letter and 
spirit of the CCSS: 

o Targets a set of grade-level CCSS 
ELA/Literacy standards, 
o Includes a clear and explicit purpose 
for instruction. 

o Selects text(s) that measure within 
the grade-level text complexity band 
and are of sufficient quality and scope 
for the stated purpose 
(e.g., presents vocabulary, syntax, text 
structures, levels of 
meaning/purpose, and other 
qualitative characteristics similar to 
CCSS grade-level exemplars in 
Appendices A & B). 

A unit or lonper lesson should: 
o Integrate reading, writing, speaking 
and listening so that students apply 
and synthesize advancing literacy 
skills. 

o (Grades 3-5) Build students' content 
knowledge and their understanding of 
reading and writing in social studies, 
the arts, science or technical subjects 
through the coherent selection of 
texts. 

The lesson/unit addresses key shifts in the CCSS: 

o Reading Text Closely: Makes reading text(s) closely, examining 
textual evidence, and discerning deep meaning a central focus of 
instruction. 

o Text-Based Evidence: Facilitates rich and rigorous evidence-based 
discussions and writing about common texts through a sequence of 
specific, thought-provoking, and text-dependent questions 
(including, when applicable, questions about illustrations, charts, 
diagrams, audio/video, and media). 

o Writing from Sources: Routinely expects that students draw 
evidence from texts to produce clear and coherent writing that 
informs, explains, or makes an argument in various written forms 
(e.g., notes, summaries, short responses, or formal essays). 

o Academic Vocabulary: Focuses on building students' academic 
vocabulary in context throughout instruction. 

A unit or lonaer lesson should: 

o Increasing Text Complexity: Focus students on reading a progression 
of complex texts drawn from the grade-level band. Provide text- 
centered learning that is sequenced, scaffolded and supported to 
advance students toward independent reading of complex texts at 
the CCR level. 

o Building Disciplinary Knowledge: Provide opportunities for students 
to build knowledge about a topic or subject through analysis of a 
coherent selection of strategically sequenced, discipline-specific 
texts. 

o Balance of Texts: Within a collection of grade-level units a balance of 
informational and literary texts is included according to guidelines in 
the CCSS (p. 5). 

o Balance of Writing: Include a balance of on-demand and process 
writing (e.g., multiple drafts and revisions over time) and short, 
focused research projects, incorporating digital texts where 
appropriate. 

The lesson/unit is responsive to varied student learning needs: 

o Cultivates student interest and engagement in reading, writing and 
speaking about texts. 

o Addresses instructional expectations and is easy to understand and use. 

o Provides all students with multiple opportunities to engage with text of 
appropriate complexity for the grade level; includes appropriate 
scaffolding so that students directly experience the complexity of the 
text. 

o Focuses on challenging sections of text(s) and engages students in a 
productive struggle through discussion questions and other supports that 
build toward independence. 

o Integrates appropriate supports in reading, writing, listening and speaking 
for students who are ELL, have disabilities, or read well below the grade 
level text band. 

o Provides extensions and/or more advanced text for students who read well 
above the grade level text band. 

A unit or lonaer lesson should: 

o Include a progression of learning where concepts and skills advance and 
deepen over time (may be more applicable across the year or several 
units). 

o Gradually remove supports, requiring students to demonstrate their 
independent capacities ( may be more applicable across the year or several 
units). 

o Provide for authentic learning, application of literacy skills, student- 
directed inquiry, analysis, evaluation and/or reflection. 

o Integrate targeted instruction in such areas as grammar and conventions, 
writing strategies, discussion rules and all aspects of foundational reading 
for grades 3-5. 

o Indicate how students are accountable for independent reading based on 
student choice and interest to build stamina, confidence and motivation 
(may be more applicable across the year or several units). 

o Use technology and media to deepen learning and draw attention to 
evidence and texts as appropriate. 

The lesson/unit regularly 
assesses whether students 
are mastering standards- 
based content and skills: 
o Elicits direct, observable 
evidence of the degree 
to which a student can 
independently 
demonstrate the major 
targeted grade-level 
CCSS standards with 
appropriately complex 
text(s). 

o Assesses student 
proficiency using 
methods that are 
unbiased and accessible 
to all students, 
o Includes aligned rubrics 
or assessment guidelines 
that provide sufficient 
guidance for interpreting 
student performance. 

A unit or lonaer lesson 
should: 

o Use varied modes of 
assessment, including a 
range of pre-, formative, 
summative and self- 
assessment measures. 

Rating: 3 2 10 

Rating: 3 2 10 

Rating: 3 2 10 

Rating: 3 2 10 


^creative 
commons 


The EQuIP rubric is derived from the Tri-State Rubric and the collaborative development process led by Massachusetts, New York, and Rhode Island and facilitated by Achieve. 

This version of the EQuIP rubric is current as of 06-24-13. 

View Creative Commons Attribution 3.0 Unported License at http://creativecommons. ora/licenses/bv/3. 0/ . Educators may use or adapt. If modified, please attribute EQuIP and re-title. 
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EQuIP Rubric for Lessons & Units: ELA/Literacy (Grades 3-5) and EL A (Grades 6-12) 


Directions: T he Quality Review Rubric provides criteria to determine the quality and alignment of lessons and units to the Common Core State Standards (CCSS) in order to: (1) Identify exemplars/ models for teachers' use 
within and across states; (2) provide constructive criteria-based feedback to developers; and (3) review existing instructional materials to determine what revisions are needed. 

Step 1 - Review Materials 

■ Record the grade and title of the lesson/unit on the recording form. 

■ Scan to see what the lesson/unit contains and how it is organized. 

■ Read key materials related to instruction, assessment and teacher guidance. 

■ Study and measure the text(s) that serves as the centerpiece for the lesson/unit, analyzing text complexity, quality, scope, and relationship to instruction. 

Step 2 - Apply Criteria in Dimension I: Alignment 

■ Identify the grade-level CCSS that the lesson/unit targets. 

■ Closely examine the materials through the "lens" of each criterion. 

■ Individually check each criterion for which clear and substantial evidence is found. 

■ Identify and record input on specific improvements that might be made to meet criteria or strengthen alignment. 

■ Enter your rating 0 - 3 for Dimension I: Alignment 

Note: Dimension I is non-negotiable. In order for the review to continue , a rating of 2 or 3 is required. If the review is discontinued, consider general feedback that might be given to developers/teachers regarding next steps. 
Step 3 - Apply Criteria in Dimensions II - IV 

■ Closely examine the lesson/unit through the "lens" of each criterion. 

■ Record comments on criteria met, improvements needed and then rate 0-3. 

When working in a group, individuals may choose to compare ratings after each dimension or delay conversation until each person has rated and recorded their input for the remaining Dimensions II - IV. 

Step 4 - Apply an Overall Rating and Provide Summary Comments 

■ Review ratings for Dimensions I - IV adding/clarifying comments as needed. 

■ Write summary comments for your overall rating on your recording sheet. 

■ Total dimension ratings and record overall rating E, E/I, R, N - adjust as necessary. 

If working in a group, individuals should record their overall rating prior to conversation. 

Step 5 - Compare Overall Ratings and Determine Next Steps 

■ Note the evidence cited to arrive at final ratings, summary comments and similarities and differences among raters. Recommend next steps for the lesson/unit and provide recommendations for improvement and/or 
ratings to developers/teachers. 

Additional Guidance for ELA/Literacy - When selecting text(s) that measure within the grade-level text complexity band and are of sufficient quality and scope for the stated purpose, see The Common Core State Standards in 
English Language Arts/Literacy at www.corestandards.org/ELA-Literacy ; and the Supplement for Appendix A: New Research on Text Complexity as well as Quantitative and Qualitative Measures at 
www.achievethecore.org/steal-these-tools/text-complexity . See The Publishers' Criteria for Grades K-2 and the same for Grades 3-12 at www.achievethecore.org/steal-these-tools . 

Rating Scales 

Note: Rating for Dimension I: Alignment is non-negotiable and requires a rating of 2 or 3. If rating is 0 or 1 then the review does not continue. 


Rating Scale for Dimensions I, II, III, IV: 

3: Meets most to all of the criteria in the dimension 
2: Meets many of the criteria in the dimension 


Overall Rating for the Lesson/Unit: 

E: Exemplar - Aligned and meets most to all of the criteria in dimensions II, III, IV (total 11 - 12) 

E/I: Exemplar if Improved - Aligned and needs some improvement in one or more dimensions (total 8 - 10) 


1: Meets some of the criteria in the dimension 
0: Does not meet the criteria in the dimension 


R: Revision Needed - Aligned partially and needs significant revision in one or more dimensions (total 3-7) 
N: Not Ready to Review - Not aligned and does not meet criteria (total 0-2) 


Descriptors for Dimensions I, II, III, IV: 

3: Exemplifies CCSS Quality - meets the standard described by criteria in the dimension, as explained in 
criterion-based observations. 

2: Approaching CCSS Quality - meets many criteria but will benefit from revision in others, as suggested in 
criterion-based observations. 


Descriptors for Overall Rating: 

E: Exemplifies CCSS Quality - Aligned and exemplifies the quality standard and exemplifies most of the criteria across Dimensions II, III, IV of 
the rubric. 

E/I: Approaching CCSS Quality - Aligned and exemplifies the quality standard in some dimensions but will benefit from some revision in 
others. 


1: Developing toward CCSS Quality - needs significant revision, as suggested in criterion-based 
observations. 


R: Developing toward CCSS Quality - Aligned partially and approaches the quality standard in some dimensions and needs significant revision 
in others. 
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EQuIP Student Work Protocol 


The ultimate goal of the Common Core State Standards (CCSS) 
is to prepare all students with the knowledge and skills they need 
for postsecondary success. The EQuIP Student Work Protocol is 
designed to establish or articulate the relationship between student 
work and the quality and alignment of instructional materials that 
previously have been reviewed using the EQuIP quality review 
process. Focusing on this relationship enables educators to develop 
a common understanding of the challenging work required by the 
CCSS. Furthermore, analyzing this relationship will also assist 
in closing the gap between what students are learning and the 
expectations embodied in assignments, as well as verifying what 
students are being taught and what they have learned, remembered, 
and incorporated into their knowledge and skills. Common 
expectations will result in more equitable educational opportunities for 
students and deepen the existing foundation for collaboration among 
states and districts. 

The specific objectives of this EQuIP Student Work Protocol are 
three-fold: 

• To confirm that a lesson’s or unit’s assignment is aligned 
with the letter and spirit of the targeted Common Core State 
Standards. 

• To determine how students performed on an assignment as 
evidence of how well designed the lesson/unit is. 

• To provide criterion-based suggestions for improving the 
assignment and related instructional materials. 

a) Where to find online: 

To view and download the EQuIP Student Work Protocol and related 
training materials, please visit: www.achieve.org/equip 


b) Who uses: 

The EQuIP Student Work Protocol is designed for use by educators, 
instructional leaders and administrators. 

c) Target materials: 

The EQuIP Student Work Protocol is intended for use with 
instructional materials that have undergone an EQuIP review, received 
a rating of E or E/I, and then subsequently have been implemented in 
an instructional setting to produce samples of student work. 

d) How to use: 

This 5-step protocol begins with a team of reviewers (or a single 
reviewer) focusing on the assignment itself — the directions or 
prompt and any accompanying scoring guides. Reviewers identify 
the content and performances required by the assignment. Reviewers 
then analyze the standards actually targeted by the author of the 
lesson/unit and the content and performances they embody. Gaps in 
alignment are noted. 

The process then turns to describing how students performed on 
the assignment and whether and how students demonstrated the 
expectations of the targeted standards. At the end of the review 
process, reviewers provide criterion-based feedback regarding 
improvements that could be made to both the assignment and related 
instructional materials. 
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Achieve 


Student Work Analysis Chart 


Student 

Work 

Sample 

What does the student's work 
demonstrate about their 
understanding of the task? 

What does the student's work 
demonstrate about their proficiency 
with the requirements of the targeted 
CCSS? 

What does the student's work 
demonstrate about the depth of 
their understanding and reasoning 
ability? 

How does the application of the 
scoring guideiines/rubrics related to 
the task support an understanding 
of the student's proficiency? 

Student 

# 





Student 

# 





Student 

# 





Student 

n 






Note: For a collection of more than four samples of student work, print this page multiple times. 
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Step 4: Analyze the Collection of Student Work. 

After each sample has been individually considered, analyze the whole collection of samples of 
student work, synthesizing the information in each column of the table used in Step 3. Use these 
questions to guide the review team's discussion of the full collection of samples. 
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Assessment Evaluation Tool 

ELA/Literacy, Grades 3-12 


This ELA/literacy AET is designed to help educators determine whether 
or not assessments and sets of assessments are aligned to the Shifts 
and major features of the Common Core State Standards (CCSS). 

The substantial instructional Shifts (http://www.corestandards.org/ 
other-resources/key-shifts-in-english-language-arts/) at the heart of the 
Common Core State Standards are: 

• Complexity: Regular practice with complex text and its 
academic language 

• Evidence: Reading, writing, and speaking grounded in 
evidence from text, both literary and informational 

• Knowledge: Building knowledge through content-rich 
non-fiction 

The AET draws directly from the following documents: 

• Common Core State Standards for English Language Arts & 
Literacy in History/Social Studies, Science, and Technical Subjects 
(http://www.corestandards.org/ELA-Literacy/) 

• Publishers’ Criteria for the Common Core State Standards in ELA/ 
Literacy grades 3-12 (http://corestandards.org/assets/ 
Publishers_Criteria_for_3-12.pdf) 

• Supplement to Appendix A of the Common Core State Standards 
for ELA/Literacy: New Research on Text Complexity (www. 
corestandards.org/assets/E0813_Appendix_A_New_Research_on_ 
Text_Complexity.pdf) 

When to use the AET 

1. Purchasing assessments: Many factors go into local 

purchasing decisions. Alignment to the Standards is a critical 
factor to consider. The AET is designed to evaluate alignment of 


assessments and sets of assessments to the Shifts and the 
major features of the CCSS. It also provides suggestions of 
additional indicators to consider in the assessment evaluation 
and purchasing process. 

2. Evaluating assessments in use: The AET can be used to analyze 
the degree of alignment of existing assessments and sets of 
assessments and help to highlight specific, concrete flaws in 
alignment. Even where assessments currently in use fail to meet 
one or more of these criteria, the pattern of failure is likely to be 
informative. States and districts can use the evaluation to create 
a thoughtful plan to modify assessments and sets of 
assessments in such a way that they better meet the 
requirements of the Standards. 

3. Developing assessments: This tool can be used to provide 
guidance for and evaluation of alignment for creating locally 
developed assessments and sets of assessments. Those 
developing new aligned assessments should use the criteria 
within the AET to guide test blueprint construction, item 
specifications development, and item evaluation procedures. 


Who Uses the AET 

The AET is designed for use by educators and administrators including 
content specialists, assessment specialists, administrators and 
educators at the school, district or state level. Evaluating assessments 
and sets of assessments requires both subject-matter and technical 
expertise. Evaluators should be well versed in the Standards (http://www. 
corestandards.org/ELA-Literacy/) for all grades in which assessments are 
being evaluated. Evaluators also should be familiar with the substantial 
instructional Shifts (http://www.corestandards.org/other-resources/ 
key-shifts-in-english-language-arts/) of Complexity, Evidence and 
Knowledge that are listed above. If possible, it would be helpful if at 
least one member of the evaluation team is well versed in ELA/literacy 
assessment. 
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Getting Started 


Prior to Evaluation 

Assemble all of the materials necessary for the evaluation, e.g., test 
forms, test blueprints, test item metadata, item bank summaries, sample 
score reports. It is essential to have materials for all grades covered 
by the assessment program, as some criteria cannot be rated without 
having access to each grade. In addition, each evaluator should have a 
reference copy of the Common Core State Standards for ELA/Literacy 
and the Publishers’ Criteria for the Common Core State Standards in 
ELA/Literacy grades 3-12. 

Sections 1 - 3 below should be completed to produce a comprehensive 
picture of the strengths and weaknesses of the assessments under 
evaluation. Information about areas in need of improvement should be 
shared with internal and external stakeholders. 

Navigating the Tool 

The AET contains criteria for five ELA/literacy domains: Reading, Writing, 
Language, and Speaking and Listening. Assessments do not have to contain 
all of the ELA/literacy domains in order to be evaluated with the AET or to align 
with the CCSS. Choose the Non-Negotiables and/or Alignment Criteria that 
apply to the assessments being evaluated. 

If reading is being assessed*, begin with Section 1 : Non-Negotiable 
Alignment Criteria (p. 220). 

• The Non-Negotiable Alignment Criteria must each be met in full for 
reading assessments to be considered aligned to the Shifts and the 
major features of the Common Core State Standards. Each Non- 
Negotiable Alignment Criterion has three metrics associated with it; 
every one of these metrics must be met in order for the criterion as a 
whole to be met. 

• Examine the relevant materials and use evidence to rate the materials 
against each criterion and its associated metrics. 

• Record and explain the evidence upon which the rating is based. 


Continue to Section 2: Alignment Criteria (p. 230). 

• The Alignment Criteria for the domains covered by the assessment 
program under evaluation must each be met for materials to be 
considered aligned to the Shifts and the major features of the Common 
Core State Standards. Each Alignment Criterion has two or more metrics 
associated with it; a specific number of these metrics must be met or 
partially met in order for the criterion as a whole to be met. 

• The domains covered within the Alignment Criteria section are: Reading, 
Writing, Language, and/or Speaking and Listening. 

• Examine the materials in relation to the relevant criteria, assigning each 
metric a point value. Rate each criterion as “Meets” or “Does Not Meet” 
based on the number of points assigned. The more points the materials 
receive on the alignment criteria, the better they are aligned. 

• Record and explain the evidence upon which the rating is based. 

Complete Section 3: Evaluation Summary (p. 259). 

• Compile all of the results from Sections 1 and 2 to determine if the 
assessments are aligned to the Shifts and major features of the CCSS. 

Proceed to Section 4: Indicators of Quality (p. 261). 

• Indicators of Quality are important considerations that will help evaluators 
better understand the overall quality of an assessment program. These 
considerations are not criteria for alignment to the CCSS, but they 
provide valuable information about additional program characteristics, 
such as ensuring accessibility for all students. Evaluators may want to 
add their own indicators to the examples provided. 

NOTE: The word “text” has been used to apply to written, audio, video, and 
quantitative stimuli. The AET should be applied to non-print materials as 
appropriate. 

* It is assumed that reading will be a significant component of most assessment 
systems subject to evaluation. When an assessment does not include Reading, 
the Alignment Criteria for the domains being evaluated (Writing, Language, 
Speaking and Listening) should be used. 
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Directions for Non-Negotiable 1 

Reading - Complexity and Quality of Texts 


SECTION 4 

Assessment Evaluation Tool (AET) 

ELA/Literacy, Grades 3-12 


Non-Negotiable 1: Texts are worthy of student time and attention; they have the appropriate level of 
complexity for the grade, according to both quantitative and qualitative analyses of text complexity. 


Required Materials 

• The texts in the test forms for each grade level or (for an item bank) 
a random sample of texts for each grade level 

• Metadata accompanying the texts, especially quantitative 
and qualitative analyses of text complexity and copyright 
acknowledgements 


Rating this Criterion 

The assessments should be rated for each of the following three 
metrics as Meets or Does Not Meet. If any one of the metrics is rated 
as Does Not Meet, then the assessments fail Non-Negotiable 1. If all 
metrics are rated as Meets, the assessments pass this Non-Negotiable. 

Whether the assessments are rated as Meets or Does Not Meet, 
provide specific examples of evidence in support of the ratings, 
including evidence of any specific gaps in the assessments. 
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Non-Negotiable 1 

Reading - Complexity and Quality of Texts 


Metric Procedure for Evaluation 


NN Metric 1A: 

At least 90% of texts used for assessment 
are placed within the grade band indicated 
by a quantitative analysis, with the average 
complexity of texts increasing grade-by- 
grade. Exceptions— in which the text is 
placed above the indicated grade band— are 
usually reserved for literary texts in the upper 
grades. When materials are published, the 
quantitative data accompany the materials. 


Every text should be accompanied by 
data from at least one research-based 
quantitative tool for grade band placement 
(poetry and drama excepted). The same 
tool(s) should be used consistently across 
the grade levels. 

If quantitative data is not available, 
evaluators should obtain a Lexile or other 
rating for the text (see http://achievethecore. 
org/text-complexity). 

For each grade, examine the metadata or 
other explanatory materials accompanying 
either the texts on the test form(s) or a 
representative sample of at least three 
literary and three informational texts from the 
item bank. 

Make a list of each text title and the grade to 
which it has been assigned; group by grade 
band. Note the grade band indicated by 
the quantitative tool(s) and the actual grade 
band placement. 

Calculate an overall percentage of the texts 
that have been placed at or below the grade 
band indicated by the quantitative data, 
allowing exceptions for literary texts as 
appropriate. 
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Non-Negotiable 1 

Reading - Complexity and Quality of Texts 


Metric 

Procedure for Evaluation 

NN Metric 1 B: 

At least 90% of texts used for assessment 
are placed within the grade level indicated 
by a qualitative analysis. When materials 
are published, the qualitative analysis 
accompanies the materials. 

Every text should be accompanied by a 
qualitative analysis for grade level placement 
(including poetry and drama). 

If a qualitative analysis is not available, 
evaluators should do a brief analysis using a 
format like the one at http://achievethecore. 
org/qualitative-text -analysis. 

For each grade, examine the qualitative 
analyses in the metadata or other 
explanatory materials accompanying the 
same texts from Non-Negotiable 1 A above. 
Note the grade level indicated by the 
qualitative tools and the actual grade level 
placement. 

Calculate an overall percentage of the texts 
that have been placed at the grade level 
indicated by the qualitative analysis. 
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Non-Negotiable 1 

Reading - Complexity and Quality of Texts 


Metric Procedure for Evaluation 


NN Metric 1C: 

At least 95% of texts used for assessment 
are of publishable quality— preferably 
previously published but at minimum edited 
by professional publication editors (not only 
assessment editors). History/social studies 
and science/technical texts, specifically, 
reflect the quality of writing that is produced 
by authorities in the particular academic 
discipline. 


All texts should be high quality and content 
rich— worthy of student attention. Nearly all 
texts should be previously published rather 
than “commissioned” because published 
texts have been selected and edited by 
professional publication editors. 

For each grade, examine the metadata or 
other explanatory materials accompanying 
the same texts from Non-Negotiable 1 A 
above. 

Look for an acknowledgment line for each 
text (usually found at the front of the test 
booklet or below the text), which cites an 
author or publisher and date of publication, 
or look for a statement that the text has been 
edited by a professional publication editor. 

Label the texts that are accompanied by an 
acknowledgment line or are shown to have 
been edited professionally. 

Identify any texts that do not represent 
quality literary or informational writing. 

Calculate the percentage of texts that are 
not of publishable quality. 
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Non-Negotiable 1 

Reading - Complexity and Quality of Texts 


SECTION 4 

Assessment Evaluation Tool (AET) 

ELA/Literacy, Grades 3-12 


Non-Negotiable 1: Texts are worthy of student time and attention; they have the appropriate level of 
complexity for the grade, according to both quantitative and qualitative analyses of text complexity. 


Rating for Non-Negotiable 1 


Rating 


If all three metrics above were rated as Meets, then rate Non-Negotiable 1 as Meets. If one or more of the metrics were rated as 
Does Not Meet, then rate Non-Negotiable 1 as Does Not Meet. Check the final rating. 

Then, briefly describe the strengths and weaknesses of these materials in light of this Criterion. 


□ 

□ 


Meets 

Does Not Meet 


Strengths / Weaknesses: 


Before moving to Non-Negotiable 2, record the final Meets or Does Not Meet rating in the Evaluation Summary on Page 259. 
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Directions for Non-Negotiable 2 

Reading - Text-Dependent and Standards-Based Questions 


SECTION 4 

Assessment Evaluation Tool (AET) 

ELA/Literacy, Grades 3-12 


Non-Negotiable 2: High-quality reading test questions are text-dependent and Standards-based; they 
require students to read closely, find the answers within the text, and use textual evidence to support 
responses. 


Required Materials 

• The test questions in the test forms for each grade level or (for an 
item bank) a representative sample of test questions 

• Metadata accompanying the test questions, showing the alignment 
of each question to the CCSS 


Rating this Criterion 

The assessments should be rated for each of the following three 
metrics as Meets or Does Not Meet. If any one of the metrics is rated 
as Does Not Meet, then the assessments fail Non-Negotiable 2. If all 
metrics are rated as Meets, the assessments pass this Non-Negotiable. 

Whether the assessments are rated as Meets or Does Not Meet, 
provide specific examples of evidence in support of the ratings, 
including evidence of any specific gaps in the assessments. 
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Non-Negotiable 2 

Reading - Text-Dependent and Standards-Based Questions 


Metric 


Procedure for Evaluation 


NN Metric 2A: 

At least 90% of the questions are text 
dependent: they require close reading and 
analysis of the text, focus on its central 
ideas and important particulars, and require 
answers based on what is in (not outside) 
the text. 


Questions should require thoughtful reading 
of the text, not just skimming or superficial 
consideration. As a set, questions should 
enable students to demonstrate deep 
understanding of the unique aspects of the 
text. Students should be able to answer the 
questions correctly without prior knowledge. 
Questions should be derived from a reading 
text (i.e., not “stand alone” questions). 

For each grade, examine either the 
test questions on the test form(s) or a 
representative sample of at least 15 questions 
based on literary texts and 15 based on 
informational texts per grade in the item bank. 

Identify the questions that do not meet this 
metric: List the sequence numbers of any 
questions that do not require close reading 
and analysis, e.g., the questions assess 
simple recall or minor textual points. List the 
sequence numbers of any questions that, 
as a set, focus on peripheral aspects of the 
text, failing to permit students to demonstrate 
deep understanding of the text. List the 
sequence numbers of any questions that call 
on students’ prior knowledge or are “stand- 
alone” questions. 

Calculate percentages of test questions that 
do not meet the metric. 
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Non-Negotiable 2 

Reading - Text-Dependent and Standards-Based Questions 


Metric 


Procedure for Evaluation 


NN Metric 2B: 

At least 90% of test questions reflect the 
range of cognitive demand required by the 
Standards. 


At every grade level, the Standards should 
be assessed with items that reflect a range 
of rigor and cognitive demand, depending 
on the requirements of individual Standards. 
Questions should reflect this range at each 
grade, always avoiding simple recall or 
surface analysis. 

For each grade, examine the same test 
questions from Non-Negotiable 2A above. 

List the sequence numbers of any questions 
that do not rise to the range of cognitive 
demand or rigor required by individual 
Standards. 

Calculate a percentage of test questions that 
do not meet this metric. 
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Non-Negotiable 2 

Reading - Text-Dependent and Standards-Based Questions 


Metric 


Procedure for Evaluation 


NN Metric 2C: 

At least 90% of test questions assess the 
specifics of the Standards at each grade 
level (not just the Anchor Standards) and 
do not employ “generic” answer choices 
applicable to any text. 


Questions should assess the specific 
requirements delineated by the Standards. For 
example, if a Standard requires a focus on two 
central ideas, two ideas should be assessed; 
if a Standard calls for the meaning of figurative 
language, meaning should be assessed, not 
literary terms like metaphor or personification. 

Questions should not be aligned only to Anchor 
Standards. Multiple-choice or technology- 
enhanced items should be text-specific, not 
relying on “generic” choices (e.g., “to inform,” 
“to persuade,” “to entertain”) that could be 
used for any text. Not every Standard must be 
assessed with every text. 

For each grade, examine the test questions 
assembled under Non-Negotiable 2A above, 
along with their metadata. Identify the questions 
that do not meet this metric: List the sequence 
numbers of any questions that fail to assess 
the specific requirements of the Standards at 
the grade level. List the sequence numbers 
of any questions that are aligned only to the 
Anchor Standards. List the sequence numbers 
of any questions that provide “generic” answer 
choices that could be used for any text. 

Calculate percentages of questions that do not 
meet the metric. 
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Non-Negotiable 2 

Reading - Text-Dependent and Standards-Based Questions 


SECTION 4 

Assessment Evaluation Tool (AET) 

ELA/Literacy, Grades 3-12 


Non-Negotiable 2: High-quality reading test questions are text-dependent and Standards-based; they 
require students to read closely, find the answers within the text, and use textual evidence to support 
responses. 

Rating for Non-Negotiable 2 Rating 


If all three metrics above were rated as Meets, then rate Non-Negotiable 2 as Meets. If one or more of the metrics were rated as 
Does Not Meet, then rate Non-Negotiable 2 as Does Not Meet. Check the final rating. 

Then, briefly describe the strengths and weaknesses of these materials in light of this Criterion. 


□ 

□ 


Meets 

Does Not Meet 


Strengths / Weaknesses: 


Before moving to the Alignment Criteria, record the final Meets or Does Not Meet rating in the Evaluation Summary on Page 259. 


Now continue by evaluating the Alignment Criteria 1-4 for Reading. 
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Directions for Alignment Criterion 1 

Reading - Range of Texts 

Alignment Criterion 1: Texts reflect the distribution of text types and genres required by the reading 
Standards. 


Required Materials Core State Standards. The more points the materials receive on the 

Alignment Criterion, the better the materials are aligned. 

• The texts in the test forms for each grade level or (for an item 

bank) a random sample of texts for each grade level Evaluators should provide examples of evidence in support of the 

numerical rating for each metric, including evidence of any specific 

• Metadata accompanying the texts, especially quantitative 9 a P s ' n materials, 

and qualitative analyses of text complexity and copyright 

acknowledgments 

• The test questions in the test forms for each grade level or (for 
an item bank) a representative sample of test questions 

• Metadata accompanying the test questions, showing the 
alignment of each question to the CCSS 

• Test blueprints and other explanatory material focused on test 
design, including sample score reports if available 


SECTION 4 

Assessment Evaluation Tool (AET) 

ELA/Literacy, Grades 3-12 


Rating this Criterion 

Rate the assessments for each of the metrics for these Alignment 
Criteria as Meets (2 points), Partially Meets (1 point), or Does Not Meet 
(0 points). Then rate the Alignment Criteria as a group as Meets or 
Does Not Meet, based on the minimum number of points required. 

For the Alignment Criteria for reading, materials must earn at least 16 
of 20 points to align to the Shifts and major features of the Common 
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Alignment Criterion 

Reading - Range of Texts 


Metric 


AC Metric 1A: 

In 1 00% of the grades, the texts on reading 
assessments or in an item bank approximate 
the distributions of literary and informational 
texts as required by the Standards: 

• In grades 3-8, there is a distribution 
of approximately 50%/50% literary and 
informational texts. 

• In grades 9-12, there is a distribution 
of approximately 33% literary and 66% 
informational texts. 

If the above metric is met, assign the 
materials 2 points. If 2 of the 3 grades 
within a grade band approximate the above 
distributions, assign 1 point. 


1 


Procedure for Evaluation 


At all grades, the proportions of literary 
vs. informational text should reflect the 
emphases in the Standards. 

For each grade, examine the metadata 
accompanying either the texts on the test 
form(s) or blueprints or a random sample of 
at least 12 texts per grade. 

List the texts and write “literary” or 
“informational” next to the title of each text. 
In accordance with the Standards, classify 
literary nonfiction texts as informational. 

Calculate the percentages of literary vs. 
informational texts for each grade. 
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Alignment Criterion 1 

Reading - Range of Texts 


Metric Procedure for Evaluation 


AC Metric 1 B: 

At least 90% of the literary and 
informational texts represent the genres 
and text characteristics that are specifically 
required by the reading Standards at each 
grade level. 

If the above metric is met, assign the 
materials 2 points. If 60% to 90% of the 
texts meet the specific requirements of the 
Standards at each grade, assign 1 point. 


At all grades, text types should match 
the Standards (e.g., specific genres 
and subgenres of fiction and nonfiction, 
foundational or seminal documents). 

For each grade, examine the metadata 
accompanying the same texts as those used 
to evaluate the metrics in Non-Negotiable 1 
above. 

Write the genre or type next to each text 
on the list (e.g., “story,” “poem,” “literary 
nonfiction,” “science/technical,” “history/ 
social studies”). 

Compare the text characteristics to those 
required by the Standards at each grade 
and identify any texts that do not match the 
characteristics for that grade. 

Calculate percentages. 
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Alignment Criterion 1 

Reading - Range of Texts 


Metric Procedure for Evaluation 


AC Metric 1C: 

Informational texts, specifically, meet 
the requirements of the Standards. At all 
grades, more than half of the informational 
texts utilize expository, rather than 
narrative, structures. In grades 6-12, the 
informational texts are balanced among 
history/social studies texts, science/ 
technical texts, and literary nonfiction. 

If the above metric is met, assign the 
materials 2 points. If one fourth to one half 
of the informational texts use expository 
rather than narrative structures and in 
grades 6-12 the informational texts 
include some history/ social studies, 
some science/technical, and some literary 
nonfiction, assign 1 point. 


The ability to understand complex 
informational texts with expository 
structures is important for college and 
career readiness, as is the ability to 
understand complex informational texts 
within a variety of disciplines. 

For each grade, note the primary structures 
in the informational texts in the list of texts 
used to evaluate the metrics in Non- 
Negotiable 1 above. 

For grades 6-12, note the subject matter 
for the informational texts used to evaluate 
the metrics in Non-Negotiable 1 above. 

Calculate whether more than half of the 
informational texts primarily use expository 
structures and in grades 6-12 whether 
there is a balance among history, science, 
and literary nonfiction. 
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Directions for Alignment Criterion 2 

Reading - Assessing Vocabulary 

Alignment Criterion 2: Because of the importance of vocabulary acquisition and use to college and 
career readiness, vocabulary questions comprise a significant part of ELA/literacy assessments, assess 
tier 2 words in context, and focus on central ideas in the text. 


SECTION 4 

Assessment Evaluation Tool (AET) 

ELA/Literacy, Grades 3-12 


Core State Standards. The more points the materials receive on the 
Alignment Criterion, the better the materials are aligned. 

Evaluators should provide examples of evidence in support of the 
numerical rating for each metric, including evidence of any specific 
gaps in the materials. 


• The test questions in the test forms for each grade level or (for 
an item bank) a representative sample of test questions 

• Metadata accompanying the test questions, showing the 
alignment of each question to the CCSS 

• Test blueprints and other explanatory material focused on test 
design, including sample score reports if available 


Required Materials 

• The texts in the test forms for each grade level or (for an item 
bank) a random sample of texts for each grade level 

• Metadata accompanying the texts, especially quantitative 
and qualitative analyses of text complexity and copyright 
acknowledgments 


Rating this Criterion 

Rate the assessments for each of the metrics for these Alignment 
Criteria as Meets (2 points), Partially Meets (1 point), or Does Not Meet 
(0 points). Then rate the Alignment Criteria as a group as Meets or 
Does Not Meet, based on the minimum number of points required. 

For the Alignment Criteria for reading, materials must earn at least 16 
of 20 points to align to the Shifts and major features of the Common 
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Alignment Criterion 2 

Reading - Assessing Vocabulary 


Metric 


Procedure for Evaluation 


AC Metric 2A: 

At least 66% of vocabulary items emphasize 
the academic language that is crucial for 
readiness, and at least 90% require use of 
context to determine meaning. 

If the above metric is met, assign the 
materials 2 points. If 40% to 66% of 
vocabulary items emphasize academic 
language, assign 1 point. 


Most of the vocabulary items on 
assessments and in an item bank should 
assess academic vocabulary (tier 2) words 
or phrases in context. The remaining 
vocabulary items should assess other kinds 
of words named in the Standards (e.g., 
figurative and domain-specific language). 

For each grade, examine either the 
vocabulary questions on the test form(s) or a 
representative sample (at least 15 vocabulary 
questions per grade) in the item bank. 

List the sequence numbers of the questions 
that do not assess academic language (tier 
2) words or phrases in context. 

Calculate percentages. 
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Alignment Criterion 2 

Reading - Assessing Vocabulary 


Metric 


Procedure for Evaluation 


AC Metric 2B: 

At least 90% of vocabulary items assess 
words or phrases that are important to 
central ideas of the text. 

If the above metric is met, assign the 
materials 2 points. If 50% to 90% of 
vocabulary items assess words or phrases 
important to central ideas, assign 1 point. 


Vocabulary items on assessments and in an 
item bank should target words and phrases 
that are significant to the meaning of the 
text, not just unusual or interesting turns of 
phrase. The tested words or phrases should 
help students gain an understanding of the 
central ideas of a text, giving students a 
significant “payoff” when they determine the 
meaning. 

For each grade, examine the vocabulary test 
questions assembled for Alignment Criterion 
2A above. 

List the sequence numbers of the questions 
that do not assess words that are important 
to the central ideas of the text. 

Calculate percentages. 
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Alignment Criterion 2 

Reading - Assessing Vocabulary 


Metric Procedure for Evaluation 


AC Metric 2C: 

Vocabulary questions comprise a sufficient 
part of ELA/literacy assessments— at least 
8 score points per test (which is a generally 
accepted minimum fora reporting category). 

If the above metric is met, assign the 
materials 2 points. If 5 - 7 score points are 
given to vocabulary questions, assign 
1 point. 


At each grade, each assessment should 
include a sufficient number of points for 
vocabulary so that vocabulary could be a 
reporting category. Providing a reporting 
category for vocabulary is desirable but is 
not required. 

For each grade, examine either the test 
blueprints or other test specifications 

Determine the number of score points 
devoted to vocabulary per grade. 
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Directions for Alignment Criterion 3 

Reading - Aligned Use of Item Types 

Alignment Criterion 3: A variety of item types is used to appropriately and strategically assess the 
Standards. 


SECTION 4 

Assessment Evaluation Tool (AET) 

ELA/Literacy, Grades 3-12 


Required Materials 

• The texts in the test forms for each grade level or (for an item 
bank) a random sample of texts for each grade level 

• Metadata accompanying the texts, especially quantitative 
and qualitative analyses of text complexity and copyright 
acknowledgements 

• The test questions in the test forms for each grade level or (for 
an item bank) a representative sample of test questions 

• Metadata accompanying the test questions, showing the 
alignment of each question to the CCSS 

• Test blueprints and other explanatory material focused on test 
design, including sample score reports if available 


Core State Standards. The more points the materials receive on the 
Alignment Criterion, the better the materials are aligned. 

Evaluators should provide examples of evidence in support of the 
numerical rating for each metric, including evidence of any specific 
gaps in the materials. 


Rating this Criterion 

Rate the assessments for each of the metrics for these Alignment 
Criteria as Meets (2 points), Partially Meets (1 point), or Does Not Meet 
(0 points). Then rate the Alignment Criteria as a group as Meets or 
Does Not Meet, based on the minimum number of points required. 

For the Alignment Criteria for reading, materials must earn at least 16 
of 20 points to align to the Shifts and major features of the Common 
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Alignment Criterion 3 

Reading - Aligned Use of Item Types 


Metric Procedure for Evaluation 


AC Metric 3A: 

Assessments employ at least one item 
type that requires students to write rather 
than select a response (brief or extended 
constructed-response or performance tasks), 
so that the depth and complexity of the 
Standards can be strategically addressed. 

If the above metric is met, assign the 
materials 2 points. If the tests employ more 
than one item type but do not include an 
item type that requires students to write a 
response, assign 1 point. 


Tests that are well aligned (2 points) make use 
of an item type that requires writing rather 
than selecting a response (brief or extended 
constructed-response items or performance 
tasks). If additional item types are used, they 
may be selected-response in format. 

Tests that are moderately aligned (1 point) 
do not offer constructed-response or 
performance tasks but make use of at least 
two different selected-response item types 
(e.g., multiple-choice, two-part evidence- 
based selected-response items, technology- 
enhanced items). 

For each grade, examine the questions 
assembled for Non-Negotiable 2A above. 

Determine which item types are being used. 
Note whether or not constructed-response 
items (either brief or extended) are included. 
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Alignment Criterion 3 

Reading - Aligned Use of Item Types 


Metric 


Procedure for Evaluation 


AC Metric 3B: 

At least 50% of the score points on each 
assessment are derived from items that 
require students to directly provide evidence 
from the text to support answers, i.e., 
the items ask students to provide details 
(quotations or paraphrases) from the text in 
support of text-based claims or inferences. 

If the above metric is met, assign the 
materials 2 points. If 30% to 50% of score 
points on each assessment are derived 
from items that require students to directly 
provide textual evidence, assign 1 point. 


Aligned tests emphasize reading and writing 
grounded in evidence from text, both literary 
and informational. Formats requiring direct 
use of evidence include: 

• Constructed-response (CR), requiring 
students to use textual evidence in written 
responses 

• Two-part evidence-based selected- 
response (EBSR), with one part asking for 
textual evidence 

■ Technology-enhanced (TE), requiring 
students to select or locate evidence 
within a passage 

• One-part multiple-choice (MC) or TE with 
answer options consisting of textual details 
(e.g., actual quotations from the text) 

For each grade, examine the questions 
assembled for Non-Negotiable 2A above, 
along with the passages on which the 
questions are based. 

List the sequence numbers of the questions 
that require direct use of textual evidence. 

Determine the number of score points. 

Calculate percentages. 
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Alignment Criterion 3 

Reading - Aligned Use of Item Types 


Metric Procedure for Evaluation 


AC Metric 3C: 

Research-focused performance tasks 
require students to analyze, synthesize, 
organize, and use information from sources; 
such tasks comprise a significant part of the 
assessments— at least 8 score points per 
test (which is a generally accepted minimum 
for a reporting category). 

If the above metric is met, assign the 
materials 2 points. If research is assessed 
with aligned test questions instead of 
performance tasks and also offers at least 8 
score points, assign 1 point. Assign 0 points 
if fewer than 8 score points are devoted to 
research skills. NOTE: Many well-aligned 
programs place research tasks within a 
writing assessment. If the materials being 
evaluated include research tasks, and the 
tasks are located in the writing assessment, 
the 2 points should still be awarded here. 


Aligned performance tasks are based on 
paired or multiple texts, and they measure 
one or more Standards that focus on 
research skills, e.g., Reading Standard 7, 
Reading Standard 9, Writing Standard 7. 

Aligned test items are based on paired or 
multiple texts, and they specifically require 
students to analyze, synthesize, organize, 
and use information from sources (e.g., not 
merely identify a title of a likely source or a 
section in a table of contents). 

For each grade, determine if there is 
sufficient coverage of research and if the 
questions meet this metric: 

• Examine either the test blueprints or 
other test specifications. 

■ Determine whether or not there are at least 
8 score points devoted to research tasks 
or test questions. 

• Examine the questions labeled as 
assessing research. 

■ Determine whether or not the questions 
require analysis, synthesis, organization, 
and use of information rather than simple 
identification. 
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Directions for Alignment Criterion 4 

Reading - Test Blueprints and Score Reports 


SECTION 4 

Assessment Evaluation Tool (AET) 

ELA/Literacy, Grades 3-12 


Alignment Criterion 4: Test blueprints and the corresponding score reports reflect the focus of the 
Standards. 


Required Materials 

• The texts in the test forms for each grade level or (for an item 
bank) a random sample of texts for each grade level 

• Metadata accompanying the texts, especially quantitative 
and qualitative analyses of text complexity and copyright 
acknowledgements 

• The test questions in the test forms for each grade level or (for 
an item bank) a representative sample of test questions 

• Metadata accompanying the test questions, showing the 
alignment of each question to the CCSS 

• Test blueprints and other explanatory material focused on test 
design, including sample score reports if available 


Core State Standards. The more points the materials receive on the 
Alignment Criterion, the better the materials are aligned. 

Evaluators should provide examples of evidence in support of the 
numerical rating for each metric, including evidence of any specific 
gaps in the materials. 


Rating this Criterion 

Rate the assessments for each of the metrics for these Alignment 
Criteria as Meets (2 points), Partially Meets (1 point), or Does Not Meet 
(0 points). Then rate the Alignment Criteria as a group as Meets or 
Does Not Meet, based on the minimum number of points required. 

For the Alignment Criteria for reading, materials must earn at least 16 
of 20 points to align to the Shifts and major features of the Common 
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Alignment Criterion 4 

Reading - Test Blueprints and Score Reports 


Metric 


Procedure for Evaluation 


AC Metric 4A: 

Test blueprints and score reports for reading 
tests are based on ELA/literacy domains 
that are research-based and instructional^ 
actionable (not CCSS cluster headings). 

If the above metric is met, assign the 
materials 2 points. If a majority of the 
reporting categories are research-based and 
actionable, assign 1 point. 


Potential reporting categories include: 
Reading, Writing, Reading Literature, 
Reading Informational Texts, Research, 
Vocabulary. This list is not exhaustive, 
and reading assessments can align to 
the CCSS without providing ail of these 
categories, depending on the purpose 
of the test. However, such CCSS cluster 
headings as “Key Ideas and Details” or 
“Craft and Structure” are not appropriate for 
use as reporting categories, as they were 
not designed to provide research-based 
instructional^ actionable guidance. 

For each grade, examine either the test 
blueprints, other test specifications or 
sample score reports. 

Determine and evaluate the names of the 
reporting categories and sub-categories. 
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Alignment Criterion 4 

Reading - Test Blueprints and Score Reports 


Metric Procedure for Evaluation 


AC Metric 4B: 

Test blueprints balance total reading word 
count and item counts per test form with 
time allotted, so that students have sufficient 
time and purpose to read carefully and 
deeply. On average, passages have 7 to 1 0 
score points each. 

If the above metric is met, assign the 
materials 2 points. If testing time allows 
for some rereading and passages have an 
average of 5 to 6 score points each, assign 
1 point. 


Aligned assessments do not overburden 
students with a large number of texts in a 
short time period and/or offer only a few 
score points for each text. Standards- 
based questions are designed to send 
students back to the text for rereading, and 
assessments should allow sufficient time. 
Also, item sets should be large and robust 
enough to provide an appropriate balance 
between the number of texts and numbers 
of questions, so that students are not asked 
to read a complex text but given only a few 
questions to answer. 

For each grade, examine the following: 

• The test form(s) 

• The test blueprints 

• The specifications for time allotted 

Determine the ratio of passage sets to time 
allotted, judging if there is sufficient time for 
rereading the passages. 

Calculate the average number of score 
points per passage. 
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Alignment Criteria 1-4 

Reading 


SECTION 4 

Assessment Evaluation Tool (AET) 

ELA/Literacy, Grades 3-12 


Points Assigned for Alignment Criteria 1-4 


Rating 


Materials must earn at least 16 of 20 points to meet the Alignment Criteria 1 - 4 for reading. If materials earn fewer than 16 
points, the Criteria have not been met. Check the final rating. 


Total (20 points possible) 


Then, briefly describe the strengths and weaknesses of these materials in light of these Criteria. 


□ Meets 

] Does Not Meet 


Strengths / Weaknesses: 


Before moving on to the next Alignment Criterion, record the final Meets or Does Not Meet rating in the Evaluation Summary on Page 259. 
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Directions for Alignment Criterion 5 

Writing - Writing to Sources 


SECTION 4 

Assessment Evaluation Tool (AET) 

ELA/Literacy, Grades 3-12 


Alignment Criterion 5: Writing tasks reflect the writing types named in the Standards and require 
students to write to sources. 


Required Materials 

• The writing prompts, performance tasks, or constructed- 
response test questions in the test forms for each grade level 
or (for an item bank) a representative sample of writing 
prompts, performance tasks, or constructed-response 

test questions 

• Metadata accompanying the prompts, tasks, or questions, 
showing the alignment of each to the CCSS 

• Test blueprints and other explanatory material focused on test 
design, including sample score reports if available 


Rating this Criterion 

Rate the assessments for each of the metrics for this Alignment 
Criterion as Meets (2 points), Partially Meets (1 point), or Does Not 
Meet (0 points). Then rate the Alignment Criterion as a whole as Meets 
or Does Not Meet, based on the minimum number of points required. 
For the Alignment Criterion for writing, materials must earn at least 3 
of 4 points to align to the Shifts and major features of the Common 
Core State Standards. The more points the materials receive on the 
Alignment Criterion, the better the materials are aligned. 


Evaluators should provide examples of evidence in support of the 
numerical rating for each metric, including evidence of any specific 
gaps in the materials. 

NOTE: Many well-aligned programs place research tasks within the 
reading assessment rather than the writing assessment. If the materials 
being evaluated include research tasks in the writing assessment, 
evaluate those tasks using Reading Alignment Criterion 3C. 


Published v.2 201 4 - send feedback to info@studentsachieve.net Reviewer Initials: 


Title of Program: 


246 


Alignment Criterion 5 

Writing - Writing to Sources 


Metric 


Procedure for Evaluation 


AC Metric 5A: 

Taking all forms of the test together, 

100% of writing tasks within a grade band 
approximate the balance of exposition, 
persuasion, and narrative required by the 
Standards (or blend writing types in similar 
proportions): 

Grades 3-5: exposition 35% 

opinion 30% 
narrative 35% 


As students progress through the grades, 
an increasing focus on both argument and 
explanatory/informational writing is crucial 
for readiness. 

For each grade band, examine either the 
writing tasks and/or constructed-response 
items on the Reading and Writing test form(s) 
or a representative sample (a minimum of 
15 prompts or tasks) from the item bank for 
each grade band. 


Grades 6-8: exposition 35% 

argument 35% 
narrative 30% 

High School: exposition 40% 

argument 40% 
narrative 0-20% 


List the writing type for each task or item. 

Calculate percentages of each of the three 
types of writing within each band. 


If the above metric is met, assign the 
materials 2 points. If narrative writing is 
greater than the indicated percentages but 
less than 50% of writing tasks, assign 1 
point. If narrative tasks comprise more than 
50% of writing tasks, assign 0 points. 
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Alignment Criterion 5 

Writing - Writing to Sources 


Metric 


Procedure for Evaluation 


AC Metric 5B: 

At least 90% of expository and argument/ 
persuasive writing tasks require writing 
to sources — i.e., students confront text 
directly, draw on textual evidence, and 
support valid inferences from the text. 

If the above metric is met, assign the 
materials 2 points. If 75% to 90% of 
expository and argument/persuasive 
prompts require writing to sources, assign 
1 point. 


For expository and argument/persuasive 
prompts, students should be required to 
read texts and draw on textual evidence to 
support valid claims and inferences. 

For each grade band, examine the writing 
items from Alignment Criterion 5A above. 

List any prompts or tasks that do not require 
writing to sources. 

Calculate the percentage of expository and 
argument/persuasive prompts requiring 
writing to sources within each band. 
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Alignment Criterion 5 

Writing - Writing to Sources 


SECTION 4 

Assessment Evaluation Tool (AET) 

ELA/Literacy, Grades 3-12 


Alignment Criterion 5: Writing tasks reflect the writing types named in the Standards and require 
students to write to sources. 


Points Assigned for Alignment Criterion 5 


Rating 


Materials must earn at least 3 of 4 points to meet Alignment Criterion 5 for writing. If materials earn fewer than 3 points, the 
Criterion has not been met. Check the final rating. 


Total (4 points possible) 


Then, briefly describe the strengths and weaknesses of these materials in light of this Criterion. 


] Meets 
] Does Not Meet 


Strengths / Weaknesses: 


Before moving to the next Alignment Criterion, record the final Meets or Does Not Meet rating in the Evaluation Summary on Page 259. 
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Directions for Alignment Criterion 6 

Language 


SECTION 4 

Assessment Evaluation Tool (AET) 

ELA/Literacy, Grades 3-12 


Alignment Criterion 6: Test questions assessing conventions and writing strategies focus on the 
specifics of the Standards and reflect actual practice to the extent possible. 


Required Materials 

• The test questions in the test forms for each grade level or (for 
an item bank) a representative sample of test questions 

• Metadata accompanying the questions, showing the alignment 
of each to the CCSS 

• Test blueprints and other explanatory material focused on test 
design, including sample score reports if available 


Rating this Criterion 

Rate the assessments for each of the metrics for this Alignment 
Criterion as Meets (2 points), Partially Meets (1 point), or Does Not 
Meet (0 points). Then rate the Alignment Criterion as a whole as Meets 
or Does Not Meet, based on the minimum number of points required. 
For the Alignment Criterion for language, materials must earn at least 
4 of 6 points to align to the Shifts and major features of the Common 
Core State Standards. The more points the materials receive on the 
Alignment Criterion, the better the materials are aligned. 

Evaluators should provide examples of evidence in support of the 
numerical rating for each metric, including evidence of any specific 
gaps in the materials. 
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Alignment Criterion 6 

Language 


Metric 


Procedure for Evaluation 


AC Metric 6A: 

At least 90% of language score points are 
derived from questions that focus on the 
specifics of the language Standards for the 
grade, assessing common errors and skills 
important for readiness. 

If the above metric is met, assign the 
materials 2 points. If at least 50% of 
language score points are derived from 
questions that assess common student 
errors and focus on the conventions and 
strategies most important for readiness, 
assign 1 point. 


Questions focused on English conventions 
and writing strategies should represent 
common student errors (not artificial or 
unlikely mistakes). 

Questions should focus on the conventions 
most important for college and career 
readiness as indicated by the Standards (see 
“Language Progressive Skills, by Grade” 
(http://www.corestandards.org/assets/ 
CCSSLELA%20Standards.pdf). 

For each grade, examine either the 
language questions on the test form(s) or a 
representative sample (at least 15 language 
questions per grade) in the item bank. 

List the sequence numbers of the questions 
that do not focus on the specifics of the 
Standards at each grade level or do not 
assess common errors. 

Calculate percentages. 
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Alignment Criterion 

Language 


Metric 


AC Metric 6B: 

At least 60% of language score points in the 
test blueprints are derived from students’ 
written responses and/or technology- 
enhanced items that mimic actual editing, 
mirroring real-world activity as closely as 
possible. 

If the above metric is met, assign the 
materials 2 points. If at least 40% of 
language score points in the test blueprints 
are derived from actual writing and/or 
technology-enhanced items that mimic 
actual editing, assign 1 point. 


6 


Procedure for Evaluation 


Students should demonstrate language 
skills in the context of actual written 
composition, with use of conventions and 
writing strategies explicitly designated as 
part of the scoring rubric. 

Alternately or in addition to actual writing, 
students should be asked to do editing or 
revision using technology-enhanced items 
that mimic actual editing and revision. 

Using the list of items generated for 
Alignment Criterion 6A above, list the 
sequence numbers of the questions that do 
not mirror real-world activity. 

Calculate percentages. 


Published v.2 2014 - send feedback to info@studentsachieve.net 


Reviewer Initials: 


SECTION 4 

Assessment Evaluation Tool (AET) 

ELA/Literacy, Grades 3-12 


Evidence 


Rating 


Meets (2) 

Partially Meets (1) 
□ Does Not Meet (0) 


Title of Program: 


252 



Alignment Criterion 

Language 


Metric 


AC Metric 6C: 

Unless only reading and writing are being 
assessed, language skills questions 
comprise a sufficient part of ELA/literacy 
assessments— at least 8 score points per 
test (which is a generally accepted minimum 
for a reporting category). 

If the above metric is met, assign the 
materials 2 points. If there are at least 6 
language score points, assign 1 point. 


6 


Procedure for Evaluation 


At each grade, each assessment should 
include a sufficient number of points for 
language skills so that language could be 
a reporting category. Providing a reporting 
category for language is desirable but is not 
required. 

For each grade, examine either the test 
form(s) or the test blueprints. 

Determine the number of test questions or 
score points devoted to language skills at 
each grade level. 
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Alignment Criterion 6 

Language 


SECTION 4 

Assessment Evaluation Tool (AET) 

ELA/Literacy, Grades 3-12 


Alignment Criterion 6: Test questions assessing conventions and writing strategies focus on the 
specifics of the Standards and reflect actual practice to the extent possible. 


Points Assigned for Alignment Criterion 6 


Rating 


Materials must earn at least 4 of 6 points to meet Alignment Criterion 6 for language. If materials earn fewer than 4 points, the 
Criterion has not been met. Check the final rating. 


Total (6 points possible) 


Then, briefly describe the strengths and weaknesses of these materials in light of this Criterion. 


] Meets 
] Does Not Meet 


Strengths / Weaknesses: 


Before moving to the next Alignment Criterion, record the final Meets or Does Not Meet rating in the Evaluation Summary on Page 259. 
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Directions for Alignment Criterion 7 

Speaking and Listening 


SECTION 4 

Assessment Evaluation Tool (AET) 

ELA/Literacy, Grades 3-12 


Alignment Criterion 7: Test questions assessing speaking and listening reflect true communication skills 
required for college and career readiness. 


Required Materials 

• The test questions in the test forms for each grade level or (for 
an item bank) a representative sample of test questions 

• Metadata accompanying the questions, showing the alignment 
of each to the CCSS 

• Test blueprints and other explanatory material focused on test 
design, including sample score reports if available 


Rating this Criterion 

Rate the assessments for each of the metrics for this Alignment 
Criterion as Meets (2 points), Partially Meets (1 point), or Does Not 
Meet (0 points). Then rate the Alignment Criterion as a whole as Meets 
or Does Not Meet, based on the minimum number of points required. 
For the Alignment Criterion for speaking and listening, materials must 
earn at least 3 of 4 points to align to the Shifts and major features of 
the Common Core State Standards. The more points the materials 
receive on the Alignment Criterion, the better the materials are aligned. 

Evaluators should provide examples of evidence in support of the 
numerical rating for each metric, including evidence of any specific 
gaps in the materials. 
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Alignment Criterion 7 

Speaking and Listening 


Metric Procedure for Evaluation 


AC Metric 7A: 

When speaking is being assessed, at least 
75% of the test questions require active 
speaking tasks rather than selected- 
response or technology-enhanced items 
about speaking practices. 

If the above metric is met, assign the 
materials 2 points. If at least 50% of the test 
questions require active speaking tasks, 
assign 1 point. 


Questions assessing speaking focus on 
students’ ability to engage effectively in a 
range of conversations and collaborations. 
Students should be asked to express and 
support ideas clearly and effectively, probing 
ideas under discussion by building on 
others’ ideas. 

For each grade, examine either the 
speaking questions on the test form(s) or a 
representative sample (at least 15 speaking 
questions per grade) in the item bank. 

List the sequence numbers of the questions 
that do not focus on the skills required for 
readiness and require active speaking. 

Calculate percentages. 
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Alignment Criterion 7 

Speaking and Listening 


Metric 


Procedure for Evaluation 


AC Metric 7B: 

When listening is being assessed, at least 
75% of the test questions require active 
listening rather than selected-response or 
technology-enhanced items about listening 
practices. 

If the above metric is met, assign the 
materials 2 points. If at least 50% of the 
test questions require active listening skills, 
assign 1 point. 


Students should be asked to express and 
support ideas clearly and effectively, probing 
ideas under discussion by building on 
others’ ideas. 

Students should also be asked to 
demonstrate such skills as taking notes on 
main ideas and asking relevant questions. 

For each grade, examine either the 
listening questions on the test form(s) or a 
representative sample (at least 15 listening 
questions per grade) in the item bank. 

List the sequence numbers of the questions 
that do not focus on the skills required for 
readiness and require active listening. 

Calculate percentages. 
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Alignment Criterion 7 

Speaking and Listening 


SECTION 4 

Assessment Evaluation Tool (AET) 

ELA/Literacy, Grades 3-12 


Alignment Criterion 7: Test questions assessing speaking and listening reflect true communication skills 
required for college and career readiness. 


Points Assigned for Alignment Criterion 7 


Rating 


If the assessments include both speaking and listening, materials must earn at least 3 of 4 points to meet the Alignment Criterion 
for speaking and listening. If materials earn fewer than 3 points, the criterion has not been met. 


Total (4 or 1 points possible) 


If the assessments include either speaking or listening, materials must earn at least 1 point to meet the Alignment Criterion. If 
materials do not receive at least 1 point, the Criterion has not been met. Check the final rating. 

Then, briefly describe the strengths and weaknesses of these materials in light of this Criterion. 


] Meets 
] Does Not Meet 

Strengths / Weaknesses: 


Move to the Evaluation Summary on the following page to record the final Meets or Does Not Meet rating. 
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AET Evaluation Summary 1 of 2 

ELA/Literacy, Grades 3-12 


SECTION 4 

Assessment Evaluation Tool (AET) 

ELA/Literacy, Grades 3-12 


Title of Assessment: Name of Evaluator(s): 

Publisher: Date of Evaluation: _ 


Signature of Each Evaluator(s): 


Non-Negotiable 

Alignment Criteria Alignment Criteria 


Each Alignment Criterion relevant to the assessments evaluated must be met with a sufficient number of points in order for the Alignment Criteria 
to be labeled as “Meets” overall. If a particular domain is not intended to be part of the assessment, indicate N/A for that criterion. The more 
points the materials receive on the relevant alignment criteria, the better they are aligned. 


Each Non-Negotiable must be met in order 
for the Non-Negotiable Alignment Criteria 
to be met overall. The Non-Negotiables 
apply to Reading assessments. If Reading is 
not intended to be part of the assessment, 
indicate N/A. 

Non-Negotiable 1: Complexity of Texts 

□ Meets Q N/A 

□ Does Not Meet 


Alignment Criteria 1-4: Reading 

Points: of 20 possible. 

(Materials must receive at least 16 of 20 
points to align.) 

] Meets Q N/A 

] Does Not Meet 


Alignment Criterion 5: Writing 

Points: of 6 possible. 

(Materials must receive at least 3 of 4 points 
to align.) 

] Meets Q N/A 

□ Does Not Meet 


Alignment Criterion 6: Language 

Points: of 6 possible. 

(Materials must receive at least 4 of 6 points 
to align.) 

□ Meets Q N/A 

□ Does Not Meet 


Non-Negotiable 2: Text-Dependent and 
Standards-Based Questions 

□ Meets Q N/A 

] Does Not Meet 


Alignment Criterion 7: Speaking and Listening 

Points: of 4 possible. 

(Materials that include both speaking and 
listening must receive at least 3 of 4 points to 
align; materials that assess either speaking or 
listening must receive at least 1 point.) 

□ Meets □ N/A 

□ Does Not Meet 


Non-Negotiable Overall: 

Alignment Criteria Overall: 



] Meets 

□ 

Meets 



| | Does Not Meet 

□ 

Does Not Meet 



Published v.2 2014 - send feedback to info@studentsachieve.net 

Reviewer Initials: 

Title of Program: 

259 









□ □ 


AET Evaluation Summary 2 of 2 

ELA/Literacy, Grades 3-1 2 


SECTION 4 

Assessment Evaluation Tool (AET) 

ELA/Literacy, Grades 3-12 


Title of Assessment: Name of Evaluator(s): 

Publisher: Date of Evaluation: 

Signature of Each Evaluator(s): 


Summary 

If the materials meet both Non-Negotiables and relevant Alignment Criteria, they are aligned to 
the Shifts and major features of the CCSS. 

Do the materials meet both Non-Negotiables and relevant Alignment Criteria? 

Yes 
No 


What are the specific areas of strength and weakness based on this review? 

Publishers or others modifying or developing assessments can use this information to make 
improvements and/or to remedy gaps in the alignment of assessment materials. 
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Indicators of Quality 


SECTION 4 

Assessment Evaluation Tool (AET) 

ELA/Literacy, Grades 3-12 


Once an evaluation for alignment to the Shifts and major features of the CCSS has been conducted using Sections 1 - 3, it is important to evaluate for 
overall quality and best practices. A starting list of Indicators of Quality is suggested below, including critical considerations such as accessibility for all 
students. States, districts and others evaluating assessment options are encouraged to add to this list to ensure materials respect curricular choices 


and reflect local contexts. These indicators are designed to apply to assessment programs; and similar indicators are reproduced in the Quality Criteria 
Checklists, which are used to evaluate individual passages and test questions. 


Indicators of Quality for Assessment Programs 


Evidence 


1 . Assessments must provide accessibility to all students, including English learners and students with disabilities: The 
assessments should be developed in accordance with the principles of universal design and sound testing practice, 
so that the testing interface, whether paper- or technology-based, does not impede student performance. Allowable 
accommodations and modifications that maintain the constructs being assessed should be offered where appropriate. 

2. Assessments should indicate progress toward college and career readiness: Scores and performance levels on assessments 
should be mapped to determinations of college and career readiness at the high school level, and for other grades, to being 
on track to college and career readiness by the time of high school graduation. 

3. Assessments must be valid for required and intended purposes. As appropriate, assessments produce data, including student 
achievement data and student growth data, that can be used to validly inform individual student gains and performance and 
other purposes such as school effectiveness and improvement. 

4. Assessments must be reliable: Assessments minimize error that may distort interpretations of results, describe the precision of 
the assessments at the cut scores, and are generalizable for the intended purposes. 

5. Assessments should be designed and implemented to yield valid and consistent test score interpretations within and 
across years: Assessment forms yield consistent score meanings over time, forms within year, student groups, and delivery 
mechanisms (e.g., paper, computer, including multiple computer platforms), and score scales used facilitate accurate and 
meaningful inferences about test performance. 
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Indicators of Quality 


SECTION 4 

Assessment Evaluation Tool (AET) 

ELA/Literacy, Grades 3-12 


Indicators of Quality for Texts Used in Reading Assessments 


Evidence 


1 . Excerpts should convey a sense of completeness: When texts are excerpts from a larger work, they should begin and end 
logically and maintain the intent of the original. Edits for length should be made at the beginning or end of the piece, rather 


than in patchwork fashion. 

2. Introductory material should include only the most necessary information. When the texts are presented with introductory 
material, the introduction should avoid summarizing or explaining the meaning of the text or giving students answers 

to questions. 

3. Illustrations should add value. When texts include visual elements, the elements should be related to the central ideas of the 
text and provide important additional information. 


4. Texts should fall within an acceptable range of word count. All texts should fall within an acceptable range for word count at 
the indicated grade level. 


5. Paired or multiple texts should have a clear and meaningful relationship with each other. When texts are paired, the potential 
points of comparison should be significant (not superficial), such as theme, amount and quality of evidence, differences in 
emphasis, distinguishable structures, changes to derivative text. 


6. For tasks that simulate research, one text should serve as an “anchor” text. When research tasks are presented, the first text 
in the set should provide foundational knowledge and lead naturally to additional reading and exploration. 
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Indicators of Quality 


SECTION 4 

Assessment Evaluation Tool (AET) 

ELA/Literacy, Grades 3-12 


Indicators of Quality for Test Questions 


Evidence 


1 . The language used in Reading items and Writing prompts should be clear and concise. The language in the items should 
reflect vocabulary and sentence structures appropriate to the grade level. 

2. Selected-response items should be presented for review with rationales for all answer choices. The metadata for the selected- 
response items (multiple-choice or technology-enhanced) should provide a rationale for every answer option. 

3. Selected-response items should exemplify high standards of technical quality. If items use a selected-response format, 
they should be free from internal clueing (e.g., the options should not repeat words in the stem; the grammatical relationship 
between stem and options should be correct for all options, the correct response should not be more specific than the 
options, the correct answer should not simply paraphrase words in the text). Also, the distractors should be plausible but 
incorrect (not unintended or arguable correct answers); general statements (e.g., central idea, theme, structure) should be 
precise and accurate; and inferences should be provable with specific textual evidence. 

4. Constructed-response items should be presented for review with sample responses. The metadata for constructed-response 
items (brief and/or extended response) should provide a top score response or a sample response for every score point. 

5. Constructed-response items should exemplify high standards of technical quality. If the items ask students to generate a 
written response, the description of the task should be clear enough that students know the characteristics of a successful 
response. Also, items that ask for a written response should be accompanied by information for students about the criteria 
for scoring. 


6. Two-part items should exemplify high standards of technical quality. If items have two parts, the relationship between the two 
parts should be clear and logical, and there should be a plausible link between the options in the two parts. 


7. Technology-enhanced items should exemplify high standards of technical quality. If items use computer delivery, they should 
use technology to approach the text in ways other item types cannot, providing value beyond that of non-technology- 
enhanced items. Also, the directions for use of technology should be clear and easy to follow. 
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Indicators of Quality 


SECTION 4 

Assessment Evaluation Tool (AET) 

ELA/Literacy, Grades 3-12 


Indicators of Quality for Test Questions 


Evidence 


8. Items that call for comparison or synthesis should focus on meaningful aspects of the texts. Questions that ask for 
comparison or synthesis should be related to central (rather than trivial) aspects of the text (e.g., amount and quality of 
evidence, differences in emphasis, distinguishable structures, changes to derivative text). 


9. Graphic organizers used in items should be text-specific and add value. When items have graphic organizers or similar 
formats, the organizer should arise from characteristics of the text, i.e., it should not be a generic format that could apply to 
any text. The organizer or format should add value to the item by allowing students to demonstrate understanding of the text 
in a way that a traditional item would not. 


students to read the full text carefully and show their understanding of the central ideas, allowing and requiring students to 
provide deep insights rather than skim the surface. 


2. As a whole, a set of items should cover the Standards that arise naturally from the unique aspects of the text. Sets of items 
should address as many different Standards as appropriate, with items based on the individual characteristics of the texts 
rather than on a forced standard coverage design. 


3. As a whole, a set of items should be ordered in a logical and helpful manner (unless item order cannot be fixed, i.e., the 
items are delivered in an adaptive system or are collected in an item bank). Sets of items should begin and/or end with general 
questions about the text; questions about particulars of the text should be presented in the order the particulars appear in 
the text. 
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Indicators of Quality for Sets of Test Questions 


Evidence 


1 . As a whole, a set of items should allow students to demonstrate deep understanding of the text. Sets of items should require 


Assessment 
Evaluation Tool (AET) 

Mathematics, Grades K-12 
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Assessment Evaluation Tool 

Mathematics, Grades K-12 


This Math AET is designed to help educators determine whether 
assessments and sets of assessments are aligned to the Shifts and 
major features of the Common Core State Standards (CCSS). The 
substantial instructional Shifts (http://www.corestandards.org/other- 
resources/key-shifts-in-mathematics/) at the heart of the Common 
Core State Standards in mathematics are: 

• Focus strongly where the Standards focus 

• Coherence: Think across grades and link to major topics 
within the grade 

• Rigor: In major topics, pursue conceptual understanding, 
procedural skill and fluency, and application with 

equal intensity. 

The AET draws directly from the following documents: 

• Common Core State Standards for Mathematics (www. 
corestandards.org/Math) 

• Publishers’ Criteria for the Common Core State Standards for 
Mathematics, Grades K-8 (Spring 2013) 
(http://www.corestandards.org/wp-content/uploads/Math_ 
Publishers_Criteria_K-8_Spring_201 3_FINAL1 .pdf), 

and Publishers’ Criteria for the Common Core State Standards 
for Mathematics, High School (Spring 2013) 
(http://www.corestandards.org/wp-content/uploads/Math_ 
Publishers_Criteria_HS_Spring_201 3_FINAL1 .pdf). 


When to use the AET 

1 . Purchasing assessments: Many factors go into local 

purchasing decisions. Alignment to the Standards is a critical 
factor to consider. This tool is designed to evaluate alignment of 
assessments and sets of assessments to the Shifts and the 
major features of the CCSS. It also provides suggestions of 
additional indicators to consider in the assessment evaluation 
and purchasing process. 


2. Evaluating assessments in use: The AET can be used to analyze 
the degree of alignment of existing assessments and sets of 
assessments and help to highlight specific, concrete flaws in 
alignment. Even where assessments currently in use fail to meet 
one or more of these criteria, the pattern of failure is likely to be 
informative. States and districts can use the evaluation to create 
a thoughtful plan to modify assessments and sets of 
assessments in such a way that they better meet the 
requirements of the Standards. 

3. Developing assessments: This tool can be used to provide 
guidance for and evaluation of alignment for creating locally 
developed assessments and sets of assessments. States and 
districts creating new aligned assessments and sets of 
assessments should use the criteria within the AET to guide the 
development of test blueprints, item specifications, and item review. 


Who Uses the AET 

The AET is designed for use by educators and administrators including 
content specialists, assessment specialists, administrators and educators at 
the school, district or state level. The AET is designed for use by educators 
and administrators including content specialists, assessment specialists, 
administrators and educators at the school, district or state level. Evaluating 
assessments and sets of assessments requires both subject-matter and 
technical expertise. Evaluators should be well versed in the Standards 
(www.corestandards.org/Math) for all grades in which assessments are 
being evaluated. This includes understanding the Major Work of the grade 
(www.achievethecore.org/focus) and the widely applicable pre-requisites 
in high school (www.achievethecore.org/prerequisites), the Supporting 
and Additional work, how the content fits into the progressions in the 
Standards (www.achievethecore.org/progressions), and the expectations 
of the Standards with respect to conceptual understanding, procedural 
skill and fluency, and application. Evaluators also should be familiar with 
the substantial instructional Shifts (http://www.corestandards.org/other- 
resources/key-shifts-in-mathematics/) of Focus, Coherence and Rigor that 
are listed above. 


The IMET was developed by Student Achievement Partners. Educators may use or adapt, ©creative 


http://creativecommons.Org/licenses/by/3.0/ 


Download this tool at http://achievethecore.org/IMET 
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Getting Started 


Prior to Evaluation 

Assemble all of the materials necessary for the evaluation, e.g., 
test blueprints, item specifications, operational forms, test items, 
metadata for those items, score reports, etc. It is essential for 
evaluators to have materials for all grades covered by the assessment 
program, as some criteria cannot be rated without having access 
to each grade. In addition, each evaluator should have a reference 
copy of the Common Core State Standards for Mathematics and 
the Publishers’ Criteria for the Common Core State Standards for 
Mathematics, Grades K-8 (Spring 2013), and the Publishers’ Criteria 
for the Common Core State Standards for Mathematics, High School 
(Spring 2013). 

Sections 1-3 below should be completed to produce a 
comprehensive picture of the alignment to the Shifts and major 
features of the CCSSM for the assessments under evaluation. 
Information about areas in need of improvement should be shared 
with internal and external stakeholders. 

Navigating the Tool 

Begin with Section 1: Non-Negotiable Alignment Criteria (p. 268) 

• The Non-Negotiable Alignment Criteria must each be met in 
full for assessments to be considered aligned to the Shifts and 
the major features of the Common Core State Standards. Each 
Non-Negotiable Alignment Criterion has one or more metrics 
associated with it; every one of these metrics must be met in 
order for the criterion as a whole to be met. 


• Examine the relevant assessments and use evidence to rate the 
materials against each criterion and its associated metric(s). 

• Record and explain the evidence upon which the rating is based. 

Continue to Section 2: Alignment Criteria (p. 278) 

• The Alignment Criteria must each be met for assessments to be 
considered aligned to the Shifts and major features of the Common 
Core State Standards. Each Alignment Criterion has one or more 
metric associated with it; a specific number of these metrics must 
be met or partially met in order for the criterion as a whole to be met. 

• Examine the assessments in relation to these criteria, assigning each 
metric a point value. Rate the criterion as “Meets” or “Does Not Meet” 
based on the number of points assigned. The more points the 
assessments receive on the Alignment Criteria, the better they are aligned. 

• Record and explain the evidence upon which the rating is based. 

Complete Section 3: Evaluation Summary (p. 298) 

• Compile all of the results from Sections 1 and 2 to determine if the 

assessments are aligned to the Shifts and major features of the CCSS. 

Proceed to Section 4: Indicators of Quality (p.300) 

• Indicators of Quality are important considerations that will help evaluators 
better understand the overall quality of an assessment program. These 
considerations are not criteria for alignment to the CCSS, but they provide 
valuable information about additional program characteristics, such as 
ensuring accessibility for all students. Evaluators may want to add their 
own indicators to the examples provided. 


The IMET was developed by Student Achievement Partners. Educators may use or adapt, ©creative 


http://creativecommons.Org/licenses/by/3.0/ 


Download this tool at http://achievethecore.org/IMET 
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Directions for Non-Negotiable 1 

Focus on Major Work 

Non-Negotiable 1 : The large majority of points in each grade K-8 are devoted to the Major Work of 
the grade, and the majority of points in each high school course are devoted to widely applicable 
prerequisites. 

Evidence, then the assessments fail this Non-Negotiable. If the 
metrics is rated as Meets, then the assessments pass this Non- 
Negotiable. 

If the metric is rated as Meets, provide specific examples of evidence 
of this. If the assessment Does Not Meet the metric, include evidence 
of specific gaps found in the materials. If the materials provide 
Insufficient Evidence, explain what is missing from the materials or 
what within the materials is unclear. 


www.corestandards.org/wp-content/uploads/Math_Publishers, 

Criteria_HS_Spring_2013_FINAL1.pdf) 

• Common Core State Standards for Mathematics 
(corestandards.org/wp-content/uploads/Math_Standards.pdf) 


Required Materials 

• Test blueprints and operational forms 

• “Focus by Grade Level” (achievethecore.org/focus) and 
the widely applicable prerequisites for postsecondary work 
(achievethecore.org/prerequisites). 

• Publishers’ Criteria for the Common Core State Standards for 
Mathematics, Grades K-8 (Spring 2013, pp. 8) (http://www. 
corestandards.org/wp-content/uploads/Math_Publishers_ 
Criteria_K-8_Spring_201 3_FINAL1 .pdf) 

• Publishers’ Criteria for the Common Core State Standards 
for Mathematics, High School (Spring 2013, pp. 7) (http:// 


SECTION 4 

Assessment Evaluation Tool (AET) 

Mathematics, Grades K-12 


Rating this Criterion 

The metric will be rated as Meets or Does Not Meet/Insufficient 
Evidence. If the metric is rated as Does Not Meet/Insufficient 
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Non-Negotiable 1 

Focus on Major Work 


Metric 


NN Metric 1A: 

For grades K-8, the assessment or set of 
assessments for each grade meet or exceed 
the following percentages: 

• 85% or more of the total score points 
in the assessment(s) for each grade 
Kindergarten, 1 , and 2 align exclusively to 
the Major Work of the grade. 

• 75% or more of the total score points in 
the assessment(s) for each grade 3, 4, and 
5 align exclusively to the Major Work of 
the grade. 

• 65% or more of the total score points in 
the assessment(s) for each grade 6, 7, and 
8 align exclusively to the Major Work of 
the grade. 

For high school, the assessment or set 
of assessments for each course meet or 
exceed the following percentage: 

50% or more of the total score points 
in each high school course assessment 
align to widely applicable prerequisites for 
postsecondary work. 


Procedure for Evaluation 


Familiarize yourself with the Major Work of 
the grade using the “Focus by Grade Level” 
documents and/or the widely applicable 
prerequisites using the “Widely Applicable 
Prerequisites” document. 

Evaluate the blueprint or operational form(s) 
for each grade/course by counting the 
total number of points aligned to the Major 
Work of the grade or widely applicable pre- 
requisites and divide by the total number of 
points on the test. 

For context, read Criterion #1 in the 
Publishers’ Criteria for the Common Core 
State Standards for Mathematics, Grades 
K-8 (Spring 2013) and Criterion #1 in the 
Publishers’ Criteria for the Common Core 
State Standards for Mathematics, High 
School (Spring 2013). 
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Rating 


□ 

□ 


Meets 

Does Not Meet / Insufficient Evidence 
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SECTION 4 

Assessment Evaluation Tool (AET) 

Mathematics, Grades K-12 

Non-Negotiable 1 : The large majority of points in each grade K-8 are devoted to the Major Work of 
the grade, and the majority of points in each high school course are devoted to widely applicable 
prerequisites. 


Non-Negotiable 1 

Focus on Major Work 


Rating for Non-Negotiable 1 


Rating 


If metrics were rated as Meets, then rate Non-Negotiable 1 as Meets. If one or more metrics were rated as Does Not Meet, then 
rate Non-Negotiable 1 as Does Not Meet. Check the final rating. 

Then, briefly describe the strengths and weaknesses of these materials in light of this Criterion. 


□ Meets 

] Does Not Meet 


Strengths / Weaknesses: 


Before moving to Non-Negotiable 2, record the final Meets or Does Not Meet rating in the Evaluation Summary on Page 298. 
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Directions for Non-Negotiable 2 

Freedom from Major Obstacles to Focus 


SECTION 4 

Assessment Evaluation Tool (AET) 

Mathematics, Grades K-12 


Non-Negotiable 2: No item assesses topics directly or indirectly before they are introduced in the CCSSM. 


Required Materials 

• Publishers’ Criteria for the Common Core State Standards for 
Mathematics, Grades K-8 (Spring 2013, pp. 9) (http://www. 
corestandards.org/wp-content/uploads/Math_Publishers_ 
Criteria_K-8_Spring_201 3_FINAL1 .pdf) 

• Common Core State Standards for Mathematics 
(corestandards.org/wp-content/uploads/Math_Standards.pdf) 

• Item specifications and operational forms or a representative 
sample of at least 20 operational items per grade/course 

• “Focus by Grade Level” (achievethecore.org/focus) and 
the widely applicable prerequisites for postsecondary work 
(achievethecore.org/prerequisites). 


If the metric is rated as Meets, provide specific examples of evidence 
of this. If the assessment Does Not Meet the metric, include evidence 
of specific gaps found in the materials. If the materials provide 
Insufficient Evidence, explain what is missing from the materials or 
what within the materials is unclear. 


Rating this Criterion 

The metric will be rated as Meets or Does Not Meet/Insufficient 
Evidence. If the metric is rated as Does Not Meet/Insufficient 
Evidence, then the assessments fail this Non-Negotiable. If the 
metrics is rated as Meets, then the assessments pass this Non- 
Negotiable. 
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Non-Negotiable 2 

Freedom from Major Obstacles to Focus 


Metric 


Procedure for Evaluation 


NN Metric 2A: 

100% of items on the assessment(s) 
assess knowledge of topics when they are 
introduced in the CCSSM. 

Commonly misaligned topics include, but 
are not limited to: 

• Probability, including chance, likely 
outcomes, probability models. (Introduced 
in the CCSSM in grade 7) 

• Statistical distributions, including center, 
variation, clumping, outliers, mean, 
median, mode, range, quartiles; and 
statistical association or trends, including 
two-way tables, bivariate measurement 
data, scatter plots, trend line, line of best 
fit, correlation. (Introduced in the CCSSM 
in grades 6-8; see CCSSM for specific 
expectations by grade level.) 

■ Similarity, congruence, or geometric 
transformations. (Introduced in the CCSSM 
in grade 8) 

• Symmetry of shapes, including line/ 
reflection symmetry, rotational symmetry. 
(Introduced in the CCSSM in grade 4) 


Evaluate item specifications to see if content 
limits specify that the commonly misaligned 
topics listed in the metric are not assessed 
in grades prior to the grade introduced in the 
CCSSM. 

Evaluate operational form(s) or a 
representative sample of at least 20 
operational items per grade/course looking 
for commonly misaligned topics prior to the 
grade levels introduced by the CCSSM. 

For context, read Criterion #2 in the 
Publishers’ Criteria for the Common Core 
State Standards for Mathematics, Grades 
K-8 (Spring 2013). 
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Non-Negotiable 2 

Freedom from Major Obstacles to Focus 


SECTION 4 

Assessment Evaluation Tool (AET) 

Mathematics, Grades K-12 


Non-Negotiable 2: No item assesses topics directly or indirectly before they are introduced in the CCSSM. 


Rating for Non-Negotiable 2 


Rating 


If the metric was rated as Meets, then rate Non-Negotiable 2 as Meets. If metric was rated as Does Not Meet, then rate Non- 
Negotiable 2 as Does Not Meet. Check the final rating. 

Then, briefly describe the strengths and weaknesses of these materials in light of this Criterion. 


□ Meets 

] Does Not Meet 

Strengths / Weaknesses: 


Before moving to Non-Negotiable 3, record the final Meets or Does Not Meet rating in the Evaluation Summary on Page 298. 
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Directions for Non-Negotiable 3 

Test Items Reflect the Coherence of the Standards 


SECTION 4 

Assessment Evaluation Tool (AET) 

Mathematics, Grades K-12 


Non-Negotiable 3: Test items elicit direct, observable evidence of the degree to which a student can 
independently demonstrate the targeted Standard(s), reflecting the coherence of the CCSSM. 


Required Materials 

• Test blueprints and operational forms or a representative 
sample of at least 20 operational items per grade/course 

• Metadata accompanying the items, showing the alignment of 
each question to the CCSS 

• Publishers’ Criteria for the Common Core State Standards for 
Mathematics, Grades K-8 (Spring 2013, pp. 13) (http://www. 
corestandards.org/wp-content/uploads/Math_Publishers_ 
Criteria_K-8_Spring_201 3_FINAL1 .pdf) 

• Publishers’ Criteria for the Common Core State Standards for 
Mathematics, High School (Spring 2013, pp. 11 and 16) (http:// 
www.corestandards.org/wp-content/uploads/Math_Publishers_ 
Criteria_HS_Spring_201 3_FINAL1 .pdf) 

• Common Core State Standards for Mathematics (http:// 
corestandards.org/wp-content/uploads/Math_Standards.pdf) 


Rating this Criterion 

Each metric will be rated as Meets or Does Not Meet/Insufficient 
Evidence. If any metric is rated as Does Not Meet/Insufficient 
Evidence, then the assessments fail this Non-Negotiable. if all metrics 
are rated as Meets, then the assessments pass this Non-Negotiable. 

If the metric is rated as Meets, provide specific examples of evidence 
of this. If the assessment Does Not Meet the metric, include evidence 
of specific gaps found in the materials. If the materials provide 
Insufficient Evidence, explain what is missing from the materials or 
what within the materials is unclear. 


• “Focus by Grade Level” (achievethecore.org/focus) and 
the widely applicable prerequisites for postsecondary work 
(achievethecore.org/prerequisites). 
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Non-Negotiable 3 

Test Items Reflect the Coherence of the Standards 


Metric 


Procedure for Evaluation 


NN Metric 3A: 

Items exhibit alignment to the CCSSM for 
the grade or course by directly reflecting 
the language of individual Standards. All, or 
nearly all, items aligned to a single Standard 
should assess the central concern of the 
Standard in question. 


Evaluate operational form(s) or a 
representative sample of at least 20 
operational items for each grade/course to 
check the alignment to the Standards for 
Mathematical Content. NOTE: An example 
of evaluating this metric might include 
ensuring that items aligned to 6.EE.A.3 
put an emphasis on applying properties 
of operations and generating equivalent 
expressions, not just mechanically 
simplifying. 
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Non-Negotiable 3 

Test Items Reflect the Coherence of the Standards 


Metric 


Procedure for Evaluation 


NN Metric 3B: 

Assessments exhibit alignment to 
the CCSSM for that grade or course: 
Operational forms for each grade/course 
include items that directly assess multiple 
levels of the content hierarchy (i.e. standard, 
cluster, and domain). 


Evaluate blueprints or operational form(s) 
for each grade/course to see if one or more 
items assess at the cluster, domain, or 
grade level. 

For context, read Criterion #6 in the 
Publishers’ Criteria for the Common Core 
State Standards for Mathematics, Grades 
K-8 (Spring 2013) and Criterion #4 in the 
Publishers’ Criteria for the Common Core 
State Standards for Mathematics, High 
School (Spring 2013). 
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Non-Negotiable 3 

Test Items Reflect the Coherence of the Standards 


SECTION 4 

Assessment Evaluation Tool (AET) 

Mathematics, Grades K-12 


Non-Negotiable 3: Test items elicit direct, observable evidence of the degree to which a student can 
independently demonstrate the targeted Standard(s), reflecting the coherence of the CCSSM. 


Rating for Non-Negotiable 3 


Rating 


If metrics were rated as Meets, then rate Non-Negotiable 3 as Meets. If one or more metrics were rated as Does Not Meet, then 
rate Non-Negotiable 3 as Does Not Meet. Check the final rating. 

Then, briefly describe the strengths and weaknesses of these materials in light of this Criterion. 


□ Meets 

] Does Not Meet 


Strengths / Weaknesses: 


Before moving to Alignment Criterion 1, record the final Meets or Does Not Meet rating in the Evaluation Summary on Page 298. 


Now continue by evaluating Alignment Criterion 1 for Rigor and Balance. 
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Directions for Alignment Criterion 1 

Rigor and Balance 

Alignment Criterion 1: The Standards set expectations for attention to all three aspects of rigor: 
conceptual understanding, procedural skill and fluency, and applications. Thus, assessments must 
reflect the balances in the Standards and help students meet the Standards’ rigorous expectations. 


SECTION 4 

Assessment Evaluation Tool (AET) 

Mathematics, Grades K-12 


Required Materials 

• Test blueprints and operational forms or a representative 
sample of at least 20 operational items per grade/course 

• Publishers’ Criteria for the Common Core State Standards for 
Mathematics, Grades K-8 (Spring 2013, pp. 12-14) (http:// 
www.corestandards.org/wp-content/uploads/Math_Publishers. 
Criteria_K-8_Spring_2013_FINAL1.pdf) 

• Publishers’ Criteria for the Common Core State Standards for 
Mathematics, High School (Spring 2013, pp. 9-10) (http:// 
www.corestandards.org/wp-content/uploads/Math_Publishers. 
Criteria_HS_Spring_201 3_FINAL1 .pdf) 

• Common Core State Standards for Mathematics (http:// 
corestandards.org/wp-content/uploads/Math_Standards.pdf) 


criterion as a whole based on the number of minimum points required 
for each criterion. In order for this Alignment Criterion to be rated 
as Meets, the materials must receive at least 5 out of 6 points. 

Each metric is important and therefore no individual metric can be 
rated as Does Not Meet for the materials to be considered aligned 
to the Shifts and major features of the CCSSM. The more points 
the materials receive on the Alignment Criterion, the better they are 
aligned. 


Rating this Criterion 

Each metric will be rated as Meets (2 points), Partially Meets (1 
point) or Does Not Meet (0 points). The ratings on those metrics 
are combined to form a Meets/Does Not Meet judgment for each 
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Alignment Criterion 1 

Rigor and Balance 


Metric Procedure for Evaluation 


AC Metric 1A: Balanced Assessment of 
Conceptual Understanding 

Standards requiring conceptual 
understanding are explicitly listed in the 
blueprint(s) and assessed to ensure students 
have met these expectations. 

(K— High School): At least 20% of the total 
points on the set of assessments for each 
grade or course explicitly require students 
to demonstrate conceptual understanding 
of key mathematical concepts, especially 
where called for in specific content 
Standards or cluster headings. 


Evaluate operational form(s) for each 
grade/course. Identify the items or parts 
of items that explicitly assess conceptual 
understanding, and add up those score 
points. Determine whether the sum 
represents at least 20% of the total points on 
the test. NOTE: Many of the items assessing 
these Standards should focus on conceptual 
understanding: 

3.NF.A.1 , 6.RP.A.2, 7.NS.A.1 , A-REI.D.10 

If operational form(s) are not available, this 
analysis may be done with test blueprints. 

For context, read Criterion #4 in the 
Publishers’ Criteria for the Common Core 
State Standards for Mathematics, Grades 
K-8 (Spring 2013) and Criterion #2 in the 
Publishers’ Criteria for the Common Core 
State Standards for Mathematics, High 
School (Spring 2013). 
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Alignment Criterion 

Rigor and Balance 


Metric 


AC Metric IB: Balanced Assessment of 
Procedural Skill and Fluency 

Standards requiring students to fluently 
compute are explicitly listed in the 
blueprint(s) and assessed to ensure students 
have met these expectations. 

(K— High School): At least 20% of the total 
points on the set of assessments for each 
grade or course explicitly assess procedural 
skill and fluency. 


1 


Procedure for Evaluation 


Evaluate operational form(s) for each grade/ 
course. Identify the items that explicitly 
address fluency and/or procedural skill, and 
add the points for those items. Determine 
whether the sum represents at least 20% 
of the total points on the test. NOTE: These 
Standards should be assessed with an 
expectation for fluency at the appropriate 
grade level: 

3.0A.C.7, 4.NBT.B.4, 5.NBT.B.5, 6.NS.B.2 

If operational forms are not available, this 
analysis can be done with test blueprints. 
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Alignment Criterion 1 

Rigor and Balance 


Metric Procedure for Evaluation 


AC Metric 1C: Balanced Assessment of 
Application 

Standards requiring students to solve 
contextual problems are explicitly listed in the 
blueprints) and assessed to ensure students 
have met these expectations. 

(K-5): At least 20% of the total points on the 
set of assessments for each grade explicitly 
assess solving single- or multi-step word 
problems. 

(6-8): At least 25% of the total points on the 
set of assessments for each grade explicitly 
assess solving single- and multi-step word 
problems and simple models. 

(High School): At least 30% of the total points 
on the set of assessments for each high 
school course explicitly assess single- and 
multi-step word problems, simple models, and 
substantial modeling/application problems. 


Evaluate the operational form(s) for each 
grade/course. Identify the items that 
explicitly address applications, and add the 
points for those items. Determine whether 
the sum represents at least 20% of the total 
points on the test. NOTE: Many of the items 
assessing these Standards should focus on 
application: 

I.OA.A.2, 4.0A.A.3, 7.EE.B.3, A-REI.B.4 

If operational forms are not available, this 
analysis can be done with test blueprints. 
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Alignment Criterion 1 Assessment Evaluation Tool (AET) 

Rigor and Balance Mathematics, Grades K-1 2 

Alignment Criterion 1: The Standards set expectations for attention to all three aspects of rigor: 
conceptual understanding, procedural skill and fluency, and applications. Thus, assessments must 
reflect the balances in the Standards and help students meet the Standards’ rigorous expectations. 


Rating for Alignment Criterion 1 


Rating 


Materials must earn at least 5 out of 6 points to meet Alignment Criterion 1 . If materials earn fewer than 5 points, the criterion 
has not been met. Check the final rating. 


Total (6 points possible) 


Then, briefly describe the strengths and weaknesses of these materials in light of this Criterion. 


□ Meets 

□ Does Not Meet 


Strengths / Weaknesses: 


Before moving to Alignment Criterion 2, record the final Meets or Does Not Meet rating in the Evaluation Summary on Page 298. 
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Directions for Alignment Criterion 2 

Emphasize the Progressions 


SECTION 4 

Assessment Evaluation Tool (AET) 

Mathematics, Grades K-12 


Alignment Criterion 2: Assessments reflect the grade-by-grade progressions in the Standards. 


Required Materials 

• Operational forms or a representative sample of at least 20 
operational items per grade/course 

• Publishers’ Criteria for the Common Core State Standards for 
Mathematics, Grades K-8 (Spring 2013, pp. 12) (http://www. 
corestandards.org/wp-content/uploads/Math_Publishers_ 
Criteria_K-8_Spring_201 3_FINAL1 .pdf) 

• Publishers’ Criteria for the Common Core State Standards for 
Mathematics, High School (Spring 2013, pp. 12) (http://www. 
corestandards.org/wp-content/uploads/Math_Publishers_ 
Criteria_HS_Spring_201 3_FINAL1 .pdf) 

• Common Core State Standards for Mathematics (http:// 
corestandards.org/wp-content/uploads/Math_Standards.pdf) 


Criterion to be rated as Meets, the materials must receive at least 7 
out of 8 points. Each metric is important and therefore no individual 
metric can be rated as Does Not Meet for the materials to be 
considered aligned to the Shifts and major features of the CCSSM. 
The more points the materials receive on the Alignment Criterion, the 
better they are aligned. 


Rating this Criterion 

Meets (2 points), Partially Meets (1 point) or Does Not Meet (0 points). 
The ratings on those metrics are combined to form a Meets/Does Not 
Meet judgment for each criterion as a whole based on the number of 
minimum points required for each criterion. In order for this Alignment 
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Alignment Criterion 2 

Emphasize the Progressions 


Metric 


AC Metric 2A: Directly Reflect the 
Progressions 

All, or nearly all, items exhibit alignment 
to the CCSSM for that grade or course by 
reflecting the progressions in the Standards. 
For example, multiplication and division 
items in grade 3 emphasize equal groups, 
with no rate problems (rate problems are 
grade 6 in CCSS). 


Procedure for Evaluation 


Evaluate operational form(s) for each grade/ 
course or evaluate the same representative 
sample of operational items from Non- 
Negotiable 3A. Determine whether each item 
does or does not reflect the progressions. 
Count the number of items that do reflect 
the progressions to evaluate whether all or 
nearly all items reflect the progressions. 

For context, read Criterion #5a in the 
Publishers’ Criteria for the Common Core 
State Standards for Mathematics, Grades 
K-8 (Spring 2013). 
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Alignment Criterion 2 

Emphasize the Progressions 


Metric Procedure for Evaluation 


AC Metric 2B: Assessing Basic Content 

Assessments include questions, tasks, and 
prompts about the basic content of the 
grade or course that are no more difficult 
than the Standards require. 


Evaluate operational form(s) for each grade/ 
course or evaluate the same representative 
sample of operational items from Non- 
Negotiable 3A. Approximately 25% of items 
should be as easy as possible and consistent 
with the requirement of the Standards 
(e.g., is no more difficult than what 
5.NF.A.1 requires). 
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Alignment Criterion 2 

Emphasize the Progressions 


Metric Procedure for Evaluation 


AC Metric 2C: The numbers across 
each set of assessments are grade 
appropriate. 

The items used across a grade/course reflect 
the full range of number systems expected in 
each grade/course. 


Evaluate operational form(s) for each grade/ 
course or evaluate the same representative 
sample of operational items from Non- 
Negotiable 3A to determine whether each 
set of assessments reflects the full range of 
number systems expected at that 
grade/course. NOTE: Some examples to 
look for in evaluating this metric include 
items involving fractions greater than 1 in 
grade 3 and arithmetic and algebra items 
in the middle grades that use the rational 
number system, not just the integers. 
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Alignment Criterion 2 

Emphasize the Progressions 


Metric 


Procedure for Evaluation 


AC Metric 2D: Offering Coherent 
Representations 

Where models are used, they are used 
consistently across grades and courses. 


Evaluate operational form(s) for each grade/ 
course or evaluate the same representative 
sample of operational items from Non- 
Negotiable 3A to determine whether 
representations are used consistently 
across grades and courses. NOTE: Some 
examples to look for in evaluating this 
metric include the following: area models 
are used for multiplication of whole numbers 
and fractions in grades 3-6, number line 
models are used for representing order and 
magnitude of numbers in each grade 2-8, 
etc. 
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Alignment Criterion 2 

Emphasize the Progressions 


SECTION 4 

Assessment Evaluation Tool (AET) 

Mathematics, Grades K-12 


Alignment Criterion 2: Assessments reflect the grade-by-grade progressions in the Standards. 


Rating for Alignment Criterion 2 


Rating 


Materials must earn at least 7 out of 8 points to meet Alignment Criterion 2. If materials earn fewer than 7 points, the criterion 
has not been met. Check the final rating. 


Total (8 points possible) 


Then, briefly describe the strengths and weaknesses of these materials in light of this Criterion. 


] Meets 

□ Does Not Meet 


Strengths / Weaknesses: 


Before moving to Alignment Criterion 3, record the final Meets or Does Not Meet rating in the Evaluation Summary on Page 298. 
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Directions for Alignment Criterion 3 

Standards for Mathematical Practice 


SECTION 4 

Assessment Evaluation Tool (AET) 

Mathematics, Grades K-12 


Alignment Criterion 3: The Standards require mathematical practices to be connected with mathematical 
content. Thus, assessments should demonstrate authentic connections between content Standards and 
practice Standards. 


Required Materials 

• Test blueprints and operational forms or a representative 
sample of at least 20 operational items per grade/course 

• Publishers’ Criteria for the Common Core State Standards for 
Mathematics, Grades K-8 (Spring 2013, pp. 12-14) (http:// 
www.corestandards.org/wp-content/uploads/Math_Publishers, 
Criteria_K-8_Spring_201 3_FINAL1 .pdf) 

• Publishers’ Criteria for the Common Core State Standards 

for Mathematics, High School (Spring 2013, pp. 12-14) (http:// 
achievethecore.org/publisherscriteria-math-hs) 

• Common Core State Standards for Mathematics (http:// 
corestandards.org/wp-content/uploads/Math_Standards.pdf) 


as Meets, the materials must receive at least 5 out of 6 points. 

Each metric is important and therefore no individual metric can be 
rated as Does Not Meet for the materials to be considered aligned 
to the Shifts and major features of the CCSSM. The more points 
the materials receive on the Alignment Criterion, the better they are 
aligned. 


Rating this Criterion 

Each metric will be rated as Meets (2 points), Partially Meets (1 
point) or Does Not Meet (0 points). The ratings on those metrics 
are combined to form a Meets/Does Not Meet judgment for each 
criterion as a whole based on the number of minimum points required 
for each criterion. In order for this Alignment Criterion to be rated 


Published v.2 201 4 - send feedback to info@studentsachieve.net Reviewer Initials: 


Title of Program: 


289 


Alignment Criterion 3 

Standards for Mathematical Practice 


Metric 


Procedure for Evaluation 


AC Metric 3A: Aligning to the Standards for 
Mathematical Practice 

All or nearly all alignments to practice 
Standards are accurate. 


Evaluate operational form(s) for each grade/ 
course or evaluate the same representative 
sample of operational items from Non- 
Negotiable 3A to check the alignment to the 
Standards for Mathematical Practice. NOTE: 
Some examples to look for when evaluating 
this metric might include the following: a 
highly scaffolded problem should not be 
aligned to MP.1 ; a problem that directs a 
student to use a calculator should not be 
aligned to MP.5; and a problem about merely 
extending a pattern should not be aligned 
to MP.8. 

For context, read Criterion #7 in the 
Publishers’ Criteria for the Common Core 
State Standards for Mathematics, Grades 
K-8 (Spring 2013) and Criterion #5 in the 
Publishers’ Criteria for the Common Core 
State Standards for Mathematics, High 
School (Spring 2013). 
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Alignment Criterion 3 

Standards for Mathematical Practice 


Metric 


Procedure for Evaluation 


AC Metric 3B: Addressing Every Standard 
for Mathematical Practice 

The set of assessments for each grade 
or course assesses every Standard for 
Mathematical Practice at least once. 


Examine test blueprints to determine 
whether or not each Standard for 
Mathematical Practice is assessed in 
each grade/course. NOTE: There is no 
requirement to have an equal balance 
among the Standards for Mathematical 
Practice. 
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Alignment Criterion 3 

Standards for Mathematical Practice 


Metric 


Procedure for Evaluation 


AC Metric 3C: Expressing Mathematical 
Reasoning 

There are multiple items in the set of 
assessment(s) for each grade or course 
that explicitly assess expressing and/or 
communicating mathematical reasoning. 


Examine operational form(s) for each grade/ 
course and count the number of items 
requiring students to express/communicate 
mathematical reasoning. 

For context, read Criterion #10 in the 
Publishers’ Criteria for the Common Core 
State Standards for Mathematics, Grades 
K-8 (Spring 2013) and Criterion #8 in the 
Publishers’ Criteria for the Common Core 
State Standards for Mathematics, High 
School (Spring 2013). 
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Alignment Criterion 3 

Standards for Mathematical Practice 


SECTION 4 

Assessment Evaluation Tool (AET) 

Mathematics, Grades K-12 


Alignment Criterion 3: The Standards require mathematical practices to be connected with mathematical 
content. Thus, assessments should demonstrate authentic connections between content Standards and 
practice Standards. 


Rating for Alignment Criterion 3 


Rating 


Materials must earn at least 5 out of 6 points to meet Alignment Criterion 3. If materials earn fewer than 5 points, the criterion 
has not been met. Check the final rating. 


Total (6 points possible) 


Then, briefly describe the strengths and weaknesses of these materials in light of this Criterion. 


□ Meets 

□ Does Not Meet 


Strengths / Weaknesses 


Before moving to Alignment Criteria 4, record the final Meets or Does Not Meet rating in the Evaluation Summary on Page 298. 
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Directions for Alignment Criterion 4 

Supporting Focus 


SECTION 4 

Assessment Evaluation Tool (AET) 

Mathematics, Grades K-12 


Alignment Criterion 4: The assessment program supports the focus of the Standards by connecting 
concepts and presenting score report information in a manner that highlights the emphasis of the grade 
or course. 


Required Materials 

• Test blueprints and operational forms or a representative 
sample of at least 20 operational items per grade/course 

• Score reports or score report documentation 

• Publishers’ Criteria for the Common Core State Standards for 
Mathematics, Grades K-8 (Spring 2013, pp. 10) (http://www. 
corestandards.org/wp-content/uploads/Math_Publishers_ 
Criteria_K-8_Spring_201 3_FINAL1 .pdf) 

• Publishers’ Criteria for the Common Core State Standards for 
Mathematics, High School (Spring 2013, pp. 8) (http://www. 
corestandards.org/wp-content/uploads/Math_Publishers_ 
Criteria_HS_Spring_2013_FINAL1.pdf) 

• Common Core State Standards for Mathematics (http:// 
corestandards.org/wp-content/uploads/Math_Standards.pdf) 

Rating this Criterion 

Each metric will be rated as Meets (2 points), Partially Meets (1 
point) or Does Not Meet (0 points). The ratings on those metrics 


are combined to form a Meets/Does Not Meet judgment for each 
criterion as a whole based on the number of minimum points required 
for each criterion. In order for this Alignment Criterion to be rated 
as Meets, the materials must receive at least 3 out of 4 points. Each 
metric is important and therefore no individual metric can be rated 
as Does Not Meet for the materials to be considered aligned to 
the Shifts and major features of the CCSSM. The more points the 
materials receive on the Alignment Criterion, the better they 
are aligned. 
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Alignment Criterion 4 

Supporting Focus 


Metric 


AC Metric 4A: Supporting Focus - Items 

In grades K-8, assessment of Supporting 
Clusters enhances focus and coherence 
simultaneously by engaging students in the 
Major Work of the grade. In each grade, at 
least 50% of items aligned to Supporting 
Clusters simultaneously engage students in 
the Major Work of the grade. 

In high school, assessments support focus 
by including items at a level of sophistication 
suitable to high school that involve 
application of knowledge and skills of key 
takeaways from grades 6-8. 


Procedure for Evaluation 


For grades K-8, examine at least 20 items 
aligned to Standards from Supporting 
Clusters for each grade and calculate 
the percentage of items sampled that 
simultaneously engage students in the Major 
Work of the grade. 

For high school, examine operational 
forms for application items at a level of 
sophistication suitable to high school that 
involve key takeaways from grades 6-8. 

For context, read Criterion #3 in the 
Publishers’ Criteria for the Common Core 
State Standards for Mathematics, Grades 
K-8 (Spring 2013) and Table 1 on Page 8 
of the Publishers’ Criteria for the Common 
Core State Standards for Mathematics, High 
School (Spring 2013), specifically the column 
titled “Applying Key Takeaways from Grades 
6 - 8 ”. 
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Alignment Criterion 4 

Supporting Focus 


Metric 

Procedure for Evaluation 

AC Metric 4B: Supporting Focus - Score 
Reports 

All score report information, including 
subscores, supporting text, and 
performance level descriptors, highlight the 
focus of the assessment(s) for each grade/ 
course. They give instructionally valuable 
data and provide information about progress 
toward college and career readiness. 

Examine a score report or documentation 
about reporting to ensure that the score 
reports highlight both focus and college and 
career readiness. 
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Alignment Criterion 4 

Supporting Focus 


SECTION 4 

Assessment Evaluation Tool (AET) 

Mathematics, Grades K-12 


Alignment Criterion 4: The assessment program supports the focus of the Standards by connecting 
concepts and presenting score report information in a manner that highlights the emphasis of the grade 
or course. 

Rating for Alignment Criterion 4 Rating 


Materials must earn at least 3 out of 4 points to meet Alignment Criterion 4. If materials earn fewer than 3 points, the criterion 
has not been met. Check the final rating. 


Total (4 points possible) 


Then, briefly describe the strengths and weaknesses of these materials in light of this Criterion. 


□ Meets 

□ Does Not Meet 


Strengths / Weaknesses: 


Move to the Evaluation Summary on the following page to record the final Meets or Does Not Meet rating. 


Published v.2 201 4 - send feedback to info@studentsachieve.net Reviewer Initials: 


Title of Program: 


297 


AET Evaluation Summary 1 of 2 

Mathematics, Grades K-12 


SECTION 4 

Assessment Evaluation Tool (AET) 

Mathematics, Grades K-12 


Title of Assessment: Name of Evaluator(s): 

Publisher: Date of Evaluation: _ 


Signature of Each Evaluator(s): 

Non-Negotiable 

Alignment Criteria Alignment Criteria 


Each Alignment must be met with a sufficient number of points in order for Alignment Criteria to be labeled as Meets overall. The more points the 
materials receive on the Alignment Criteria, the better they are aligned. 


Each Non-Negotiable must be met in order 
for the Non-Negotiable Alignment Criteria to 
be met overall. 

Non-Negotiable 1: Focus on Major Work 

□ Meets 

□ Does Not Meet 

Non-Negotiable 2: Freedom from Major 
Obstacles to Focus 

] Meets 

] Does Not Meet 

Non-Negotiable 3: Test Items Reflect the 
Coherence of the Standards 

□ Meets 

□ Does Not Meet 


Alignment Criteria 1: Rigor and Balance 

Points: of 6 possible. 

(Materials must receive at least 5 of 6 points 
to align.) 

] Meets 

□ Does Not Meet 

Alignment Criteria 4: Supporting Focus 

Points: of 4 possible. 

(Materials must receive at least 3 of 4 points 
to align.) 

□ Meets 

□ Does Not Meet 


Alignment Criteria 2: Emphasize the 
Progression 

Points: of 8 possible. 

(Materials must receive at least 7 of 8 points 
to align.) 

] Meets 

] Does Not Meet 


Alignment Criteria 3: Standsards for 
Mathematical Practice 

Points: of 6 possible. 

(Materials must receive at least 5 of 6 points 
to align.) 

] Meets 

] Does Not Meet 


Non-Negotiable Overall: Alignment Criteria Overall: 


] Meets 

] Meets 

EH Does Not Meet 

EH Does Not Meet 
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AET Evaluation Summary 2 of 2 

Mathematics, Grades K-12 


Title of Assessment: 
Publisher: 


Summary 

If the materials meet every Non-Negotiable and Alignment Criterion, they are aligned to the 
Shifts and major features of the CCSS. 

Do the materials meet every Non-Negotiable and Alignment Criteria? 

□ Yes 

□ No 


What are the specific areas of strength and weakness based on this evaluation? 

Publishers or those implementing assessment can use this information in order to make 
improvements and/or improve documentation to account for known gaps in the materials. 
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Indicators of Quality 


SECTION 4 

Assessment Evaluation Tool (AET) 
Mathematics, Grades K-1 2 


Once an evaluation for alignment to the Shifts and major features of the CCSS has been conducted using Sections 1 -3, it’s important to evaluate for overall 
quality and best practices. A starting list of Indicators of Quality is suggested below, including critical considerations such as accessibility for all students. 
States, districts and others evaluating assessment options are encouraged to add to this list to ensure materials respect curricular choices and reflect local 
contexts. These indicators are designed to apply to assessment programs; and similar indicators are reproduced in the Quality Criteria Checklists, which are 
used to evaluate individual test questions. 

Indicators Evidence 


1 . Assessments must provide accessibility to all students, including English learners and students with disabilities: The 
assessments should be developed in accordance with the principles of universal design and sound testing practice, so that 
the testing interface, whether paper- or technology-based, does not impede student performance. Allowable accommodations 
and modifications that maintain the constructs being assessed should be offered where appropriate. 


2. Assessments must be valid for required and intended purposes. As appropriate, assessments produce data, including student 
achievement data and student growth data that can be used to validly inform individual student gains and performance and 
other purposes such as school effectiveness and improvement. 


3. Assessments must be reliable. Assessments minimize error that may distort interpretations of results, describe the precision of 
the assessments at the cut scores, and are generalizable for the intended purposes. 


4. Assessments should be designed and implemented to yield valid and consistent test score interpretations within and 
across years. Assessment forms yield consistent score meanings overtime, forms within year, student groups, and delivery 
mechanisms (e.g., paper, computer, including multiple computer platforms), and score scales used facilitate accurate and 
meaningful inferences about test performance. 


5. Reflecting Strong Mathematical Content. The assessment items, answer keys, and supporting documentation are free from 
mathematical errors. 


6. Constructing Forms Without Cueing Solution Processes. Item sequences do not cue the student to use a certain solution 
process during problem solving. Assessment(s) include problems requiring different types of solution processes within the 
same section. 
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Indicators of Quality 


SECTION 4 

Assessment Evaluation Tool (AET) 

Mathematics, Grades K-12 


Indicators 


Evidence 


7. Using Grade-Appropriate Presentation. The graphics, diagrams, and wording in each item are appropriate for students at that 
grade level. 

8. Ensuring Forms Have Grade-Appropriate Reading Demands. The form as a whole (including directions, stimuli, items, etc.) has 
grade-appropriate readability levels. 


9. Clear Scoring Materials and Procedures. For open-ended items, there are clear rubrics with exemplars that are valid for all 
possible solution paths. The procedure to use these materials to score student work is clear. 


10. Calling for Variety in Student Work. Forms give many opportunities for students to produce a variety of responses. For 
example, items require students to produce answers and solutions, but also, in a grade-appropriate way, arguments and 
explanations, diagrams, mathematical models, etc. (Refer also to Criterion #9 in the Publishers’ Criteria for the Common Core 
State Standards for Mathematics, Grades K-8 (Spring 2013) and Criterion #7 in the Publishers’ Criteria for the Common Core 
State Standards for Mathematics, High School (Spring 2013).) 

1 1 . Utilizing a Variety of Ways to Present the Content. Items on operational forms present mathematical content in a variety of 
ways so that students must thoughtfully engage with various application contexts, mathematical representations, and 
structures of equations. 
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Assessment Passage & Item 
Quality Criteria Checklists 


ELA/Literacy Passages, Grades 3-12 

Quality Checklist for Assessment Texts Worth Reading 
Quality Checklist for Assessment Questions Worth Asking 
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Assessment Passage & Item 
Quality Criteria Checklist 


ELA/Literacy Quality Checklist for 
Assessment Texts Worth Reading 

The following checklist has been designed to help evaluators of ELA/ 
literacy assessments determine if texts used to assess Reading and/ 
or Writing align to the Common Core State Standards (CCSS). 

The checklist has been set up in a gated manner so that evaluators 
can quickly determine if or whether a text aligns to, or strays from, 
the expectations of the CCSS. If a text does not pass the criteria in 
Section 1 and cannot be moved to a different grade, the text should 
be removed from consideration. If a text does pass the criteria in 
Section 1 or passes by being moved to a different grade, the text 
should be evaluated against the additional criteria in Section 2. 

Use the center column to explain each determination. Have the 
Common Core State Standards for ELA/Literacy open for continual 
reference. At the end of Section 2, rate the text as Accepted, 
Accepted Conditionally, or Rejected. 

In this document, the word “text” refers to all kinds of stimuli used in 
Reading and Writing assessments, as appropriate, e.g., printed texts, 
video, audio, charts, graphs. 


The IMET was developed by Student Achievement Partners. Educators may use or adapt, ©creative 


http://creativecommons.Org/licenses/by/3.0/ 


Download this tool at http://achievethecore.org/IMET 
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Assessment Text Quality Criteria 
Checklist Section 1 


SECTION 5 

Quality Checklist for Assessment Texts Worth Reading 

ELA/Literacy Passages, Grades 3-12 


For evaluation of individual texts and sets of texts: Each text must meet all of the following criteria. A 
text that does not pass the criteria in this section and cannot be moved to a different grade does not 
need to be evaluated further. 


Criteria 

Details 

Evidence 

1 .1 Quantitative measures of text 
complexity should determine grade-band 
placement: 

Has the text been placed within the grade 
band indicated by a quantitative analysis 
(with the exception of some literary texts 

Every text should be accompanied by 
specific evidence that it has been analyzed 
with at least one research-based quantitative 
tool for grade-band placement, with 
the exceptions of poetry and drama. If 
quantitative data is not available, evaluators 


written in simple style)? 

should obtain a Lexile or other rating for 
the text (see http://achievethecore.org/ 
text -complexity). Note that some literary 
texts, especially in high school, may be 
placed above the grade band indicated by 
quantitative data because of mature ideas 
and themes. 

Rating: 

□ Yes 

□ No 

] Move (to grade ) 


1 .2 Qualitative analyses of text 
complexity should determine grade 
level placement: 

Has the text been placed at the grade level 
indicated by a qualitative analysis? 

□ Yes 

□ No 

] Move (to grade ) 


Every text should be accompanied by 
specific evidence that it has been analyzed 
with a qualitative measure for grade-level 
placement. If a qualitative analysis is not 
available, evaluators should use a tool 
that focuses on qualitative aspects of text 
complexity (see http://achievethecore.org/ 
qualitative-text-analysis). 


Rating: 
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Assessment Text Quality Criteria 
Checklist Section 1 


Criteria Details 


1.3 Text quality is fundamental to 
text selection: 

Does the text represent professional-quality 
literary or informational writing? 


The text should demonstrate coherence, 
thorough development of ideas, clear 
use of evidence and details, and effective 
structure. A history/social studies or 
science/technical text, especially, should 
reflect the factual accuracy and quality 
of writing that is produced by authorities 
in the particular academic discipline. To 
meet quality requirements, the text will 
most likely be previously published. If 
the text was “commissioned,” evaluate it 
closely for richness of content and clarity of 
organization, as many commissioned texts 
are thin and diffuse. 


1.4 All texts must align to the particulars 
of the grade-level Standards: 

Do the characteristics of the text (e.g., 
story, literary nonfiction, historical account, 
scientific procedure) accurately represent the 
specific requirements of the Standards at the 
designated grade? 


This requirement also applies to pairs or 
multiple texts; the Standards often have 
specific requirements for pairing texts. 
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Quality Checklist for Assessment Texts Worth Reading 

ELA/Literacy Passages, Grades 3-12 


Evidence 


Rating: 

□ Yes 

□ No 

NOTE: (“Move” is not an option; poor quality texts should never be used) 


Rating: 

□ Yes 

□ No 

] Move (to grade ) 
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Assessment Text Quality Criteria 
Checklist Section 1 


SECTION 5 

Quality Checklist for Assessment Texts Worth Reading 

ELA/Literacy Passages, Grades 3-12 


Criteria 


Details 


Evidence 


1.5 Audio or video texts must meet the 
quality criteria that other texts do: 

If a text is an audio or video stimulus, does 
it provide rich content and represent high- 
quality sound and/or viewing production? 


These texts must be content rich and have 
appropriate clarity and accents so that they 
can be clearly understood. 


Rating: 

□ Yes 

□ No 

] N/A (not audio or visual) 

NOTE: (“Move” is not an option; poor quality texts should never be used) 


If the text has any “No’s” for any one of the questions above, remove it from consideration. 
If the text has all “Yes” or “Moves,” proceed to Section 2. 
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Assessment Text Quality Criteria 
Checklist Section 2 


SECTION 5 

Quality Checklist for Assessment Texts Worth Reading 

ELA/Literacy Passages, Grades 3-12 


Texts that pass the first section must next meet the following criteria, as applicable, possibly after revisions. 


Criteria 


Details 


Evidence 


2.1 Excerpts must be selected with care: 

If the text is an excerpt from a larger work, 
does it carry a sense of completeness and 
maintain the intent of the original, and are 
edits for length made at the beginning or 
end of the piece, rather than in 
patchwork fashion? 


If “No” is checked, recommend changes 
in the excerpting or reject the text and 
recommend replacing it with a more 
complete excerpt. 


Rating: 

□ Yes 

□ No 
] N/A 


2.2 Introductory material must include If “No” is checked, suggest edits to 

only the most necessary information: the introduction. 

If the text is presented with introductory 
material, does the introduction avoid 
summarizing or explaining the meaning of 
the text or giving students answers 
to questions? 


Rating: 

□ Yes 

□ No 

□ N/A 


Published v.2 2014 - send feedback to info@studentsachieve.net 


Reviewer Initials: 


Title of Program: 


308 


Assessment Text Quality Criteria 
Checklist Section 2 


Criteria Details 


2.3 Illustrations must add value: If “No” is checked, suggest adding or 

If a text includes visual elements, are they deleting specific illustrations, 

related to the central ideas of the text, and 
do they provide important 
additional information? 


2.4 Expository text structures are 
desirable for informational texts: 

If an informational text uses chronological 
rather than expository structures, is there 
sufficient justification, in terms of quality 
and/or subject matter, for its use? 


If “No” is checked, suggest replacing the 
text with one that uses expository structures 
unless there is sufficient justification for 
its use. 
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Evidence 


Rating: 

□ Yes 

□ No 

□ N/A 


Rating: 

□ Yes 

□ No 

□ N/A 
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Assessment Text Quality Criteria 
Checklist Section 2 


Criteria Details 


2.5 Each text must fall within an If “No” is checked, reject the text or suggest 

acceptable range of word count: edits for length. 

Does the text fall within an acceptable range 
for word count at the indicated grade level? 


2.6 Paired or multiple texts must have 
a clear and meaningful relationship with 
each other: 

If texts are paired, are the potential points of 
comparison significant (not superficial), such 
as theme, amount and quality of evidence, 
differences in emphasis, distinguishable 
structures, changes to derivative text? 


If “No” is checked, reject one or more 
of the texts and, if possible, make 
recommendations for replacements. 
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ELA/Literacy Passages, Grades 3-12 


Evidence 


Rating: 

□ Yes 

□ No 


Rating: 

□ Yes 

□ No 

□ N/A 
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Assessment Text Quality Criteria 
Checklist Section 2 


SECTION 5 

Quality Checklist for Assessment Texts Worth Reading 

ELA/Literacy Passages, Grades 3-12 


Criteria 


Details 


Evidence 


2.7 For tasks that simulate research, one 
text should serve as an “anchor” text: 

Does the first text in the set provide 
foundational knowledge and lead naturally to 
additional reading and exploration? 


If “No” is checked, suggest another text as 
the anchor or recommend replacing one or 
more texts. 


Rating: 

□ Yes 

□ No 
] N/A 


□ Accepted (all Yes) 


Overall Rating for Checklist #2: 

□ Accepted conditionally, with comments to be addressed 


□ Rejected 
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Assessment Passage & Item 
Quality Criteria Checklist 


ELA/Literacy Quality Checklist for 
Assessment Questions Worth Asking 

The following checklist has been designed to help evaluators of ELA/ 
literacy assessments determine if individual test questions (items) in 
Reading and/or Writing assessments align to the Common Core State 
Standards (CCSS). 

The checklist has been set up in a gated manner so that evaluators 
can quickly determine whether an item aligns to, or strays from, the 
expectations of the CCSS. If an item does not pass the applicable 
criteria in Section 1 , the item should be removed from consideration. 

If an item does pass the applicable criteria in Section 1, it should be 
evaluated against the additional criteria in Section 2. 

Use the center column to record each determination. Have the 
Common Core State Standards for ELA/Literacy open for continual 
reference. At the end of Section 2, the item can be marked as 
Accepted, Accepted Conditionally, or Rejected. 

In this document, the word “item” refers to all formats of 
test questions. 


The IMET was developed by Student Achievement Partners. Educators may use or adapt, ©creative 
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Assessment Item Quality Criteria 
Checklist Section 1 


SECTION 5 

Quality Checklist for Assessment Questions Worth Asking 

ELA/Literacy Passages, Grades 3-12 


For evaluation of individual items and sets of items: Each item must meet all of the following criteria. An 
item that does not pass the criteria in this section does not need to be evaluated further. 


Criteria 


Details 


Evidence 


1.1 Reading test questions must be text- 
dependent, requiring analysis of text and 
use of evidence: 

If it is a Reading test question, does the item 
require close reading and careful analysis 
of the text— by asking for either direct or 
indirect use of textual evidence, as required 
by Reading Standard 1 ? 


Every Reading item must require students 
to use evidence from the text either directly, 
by citing textual evidence, or indirectly, by 
relying on textual evidence to make a claim 
or inference. 


Rating: 

□ Yes 

□ No 

□ N/A 


1.2 Writing prompts should be text- 
dependent, requiring analysis of text and 
use of evidence: 

If it is a Writing prompt, does the item require 
students to analyze text and provide textual 
evidence in their response, as required by 
Writing Standard 9? 


If the prompt calls for narrative writing, 
this requirement can be marked as N/A; 
however, narrative prompts that do require 
textual analysis are more desirable than 
those that do not. 


Rating: 

□ Yes 

□ No 

□ N/A 
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Assessment Item Quality Criteria 
Checklist Section 1 


Criteria 


Details 


1.3 Reading test questions and Writing 
prompts must be worthy of 
student attention: 

Does the item focus on the central ideas or 
important particulars of the text, rather than 
insignificant or peripheral aspects? 


Reading items and Writing prompts must 
allow students to deliver significant insights 
about the text. 


1.4 Reading test questions and Writing 
prompts must align to grade-level 
Standards: 

Does the item genuinely (not superficially) 
align to the intent of the grade-level 
Standard(s) indicated in the item metadata? 


Reading items must align to the intent of 
at least one Reading Standard (in addition 
to Standard 1), avoiding mere surface 
treatment of any Standard. Writing prompts 
must be designed to elicit one of the three 
types of writing named in Writing Standards 
1 , 2, and 3 (as well as aligning to Standard 
9). A “blended” writing type is also aligned. 
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Evidence 


Rating: 

□ Yes 

□ No 


Rating: 

□ Yes 

□ No 
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Assessment Item Quality Criteria 
Checklist Section 1 


SECTION 5 

Quality Checklist for Assessment Questions Worth Asking 

ELA/Literacy Passages, Grades 3-12 


Criteria 


Details 


Evidence 


1 .5 Items assessing vocabulary must 
focus on words and phrases that are 
important to central ideas in the text: 

If the test question is a Reading item or 
Writing prompt assessing vocabulary, does it 
assess a word or phrase that is important to 
understanding the central ideas of the text, 
giving students a “payoff” in gaining greater 
understanding the meaning of the text? 


Items should avoid focusing on unusual 
words or turns of phrase that may stand 
out as interesting but do not advance 
an understanding of the text, nor should 
vocabulary items be “stand-alone” (e.g., 
based on a single phrase or sentence 
without any reading passage). 


Rating: 

□ Yes 

□ No 

□ N/A 


If the text has any “No’s” for any one of the applicable questions above, remove it from consideration. 
If the text has all “Yes” and appropriate “N/A’s,” proceed to Section 2. 
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Assessment Item Quality Criteria 
Checklist Section 2 


SECTION 5 

Quality Checklist for Assessment Questions Worth Asking 

ELA/Literacy Passages, Grades 3-12 


Items that pass the first section must next meet the following criteria, as applicable, possibly after revisions. 


Criteria 

Details Evidence 

2.1 Items must align to the Standards 
(see 1 .5 above) but may require revisions 
in wording or in the Standards designated 
for alignment: 

If “No” is checked, suggest revisions in 
wording and/or a different alignment, or 
reject the item. 

Is the alignment of the item to Reading and / 
or Writing Standards as precise as possible? 

Rating: 


□ Yes 


□ No 

2.2 The language used in Reading items 
and Writing prompts should be text- 
specific, as appropriate: 

Does the item use language specific to the 

If “No” is checked, reject the item or suggest 
revisions unless the use of generic language 
is appropriate to the Standard being tested 
(e.g., “What is the central idea?”). 

text, avoiding generic or “canned” items that 
could be used with any text? 

Rating: 


□ Yes 


□ No 

2.3 The language used in Reading items 
and Writing prompts must be clear 
and concise: 

If “No” is checked, reject the item or 
suggest revisions. 

Will students readily understand the 
language in the item because it employs 
vocabulary and sentence structures 

Rating: 

appropriate to the grade level? 

□ Yes 


□ No 
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Assessment Item Quality Criteria 
Checklist Section 2 


Criteria 


Details 


2.4 Each item must exemplify high If “No” is checked, reject the item or 

Standards of technical quality: suggest revisions*. 

If the item uses a selected-response format, 
is the item free from internal clueing (e.g., the 
options do not repeat words in the stem; the 
grammatical relationship between stem and 
options is correct for all options; the correct 
response is not more specific than the 
options; the correct answer does not simply 
paraphrase words in the text)? 


If the item uses a selected-response If “No” is checked, reject the item or 

format, are the distractors plausible but suggest revisions*. 

incorrect (not unintended or arguable correct 

answers), are general statements precise 

and accurate, and can claims and inferences 

be supported by textual evidence? 


If the item asks students to generate a If “No” is checked, reject the item or 

written response, is there a clear description suggest revisions*, 
of the task, accompanied by information for 
students about the criteria for scoring? 
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ELA/Literacy Passages, Grades 3-12 


Evidence 


Rating: 

□ Yes 
□ No 

N/A 


Rating: 

□ Yes 
□ No 

N/A 


Rating: 

□ 

Yes 

□ 

No 

□ 

N/A 
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Assessment Item Quality Criteria 
Checklist Section 2 

Criteria Details 


If the item has two parts, is the relationship If “No” is checked, reject the item or 
between the two parts clear and logical, and suggest revisions, 
is there a plausible link between the options 
in the two parts? 


If the item uses computer delivery, does it If “No” is checked, reject the item or 

use technology to approach the text in ways suggest revisions. 

other item types cannot, providing value 

beyond that of a non-technology 

enhanced item? 


If the item uses computer delivery, are the 
directions for use of technology clear and 
easy to follow? 


If “No” is checked, reject the item or 
suggest revisions. 
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Evidence 


Rating: 

□ 

Yes 

□ 

No 

□ 

N/A 


Rating: 

□ 

Yes 

□ 

No 

□ 

N/A 


Rating: 

□ Yes 
□ No 

N/A 
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Assessment Item Quality Criteria 
Checklist Section 2 

Criteria Details 


If the item assesses vocabulary, does it 
assess the kinds of words and phrases 
delineated in the grade-level Standards? 


If “No” is checked, reject the item or 
suggest revisions. 


If the item calls for comparison or synthesis, if “No” is checked, reject the item or 

is the question related to central (rather than suggest revisions. 

trivial) aspects of the text (e.g., amount and 

quality of evidence, differences in emphasis, 

distinguishable structures, changes to 

derivative text)? 


If the item contains a graphic organizer or if “No” is checked, reject the item or 

similar format, does the organizer or format suggest revisions. 

add value to the item by allowing students to 

demonstrate understanding of the text in a 

way that a traditional item would not? 
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Evidence 


Rating: 

□ Yes 
□ No 

N/A 


Rating: 

□ 

Yes 

□ 

No 

□ 

N/A 


Rating: 

□ 

Yes 

□ 

No 

□ 

N/A 
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Assessment Item Quality Criteria 
Checklist Section 2 

Criteria Details 


2.5 Sets of items must provide deep and If “No” is checked, reject the set or suggest 
comprehensive coverage of the text: ideas for additional items. 

As a whole, does the set of items require 
students to read the full text carefully and 
show their understanding of the central 
ideas, allowing and requiring students to 
provide deep insights rather than skim 
the surface? 


As a whole, does the set address as many If “No” is checked, reject the set or suggest 

different Standards as appropriate, with ideas for addition or deletion of items, 

items based on the individual characteristics 
of the text rather than on a forced 
standard coverage? 


As a whole, is the set of items large and 
robust enough so that a test form is likely to 
have an appropriate balance between the 
number of texts and numbers of questions, 
giving students sufficient incentive to read 
closely and carefully? 


If “No” is checked, reject the set or suggest 
ideas for additional items. 
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ELA/Literacy Passages, Grades 3-12 


Rating 


Rating: 

□ Yes 
□ No 


Rating: 

□ Yes 
□ No 


Rating: 

□ Yes 
□ No 


Title of Program: 


320 





SECTION 5 

Quality Checklist for Assessment Questions Worth Asking 

ELA/Literacy Passages, Grades 3-12 

Criteria Details Rating 


As a whole, is the set of items free from If “No” is checked, reject the set or suggest 

clueing (so that one item does not provide ideas for revisions, 

the correct answer for another)? 


Assessment Item Quality Criteria 
Checklist Section 2 


Rating: 

□ Yes 
□ No 


□ Accepted (all yes) 


Overall Rating for Checklist #2: 

□ Accepted conditionally, with comments to be addressed 


□ Rejected 


* Consider asking for a rationale for every answer option (MC and TE items) and a sample response for every score point (CR items). Providing rationales and sample responses is best practice in 
assessment development and tends to generate better quality items. 
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Assessment Item Quality 
Criteria Checklists 


Mathematics, Grades 3-12 


322 


Assessment Item Quality 
Criteria Checklist 

Process for Evaluating Items for Common 
Core State Standards-Aligned Assessments 

Step 1 : Solve the item. 

Step 2: Evaluate the item according to the criteria on the following 
page. The criteria are set-up in a gated manner so that evaluators can 
quickly and systematically determine whether an item aligns to, or 
strays from, the expectations of the CCSSM. Evaluators use the right 
column to record “Yes/No/Revised” or “Revised” as appropriate. 

• “Yes”: the item meets the expectations of the criterion; 

• “No”: the item does not meet the expectation of the criterion; 

• “Revised”: the item, as it currently exists, does not meet the 
criterion, but could be revised to do so; and 

• in the second section, check “N/A” if the criterion is not 
applicable to the item. 

Use the center column to explain your determination using evidence. 

Have the Common Core State Standards for Mathematics open for 
continual reference. 
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Criteria for Evaluating Items for Common Core 
State Standards-Aligned Assessments 


SECTION 5 

Assessment Item Quality Criteria Checklist 

Mathematics, Grades 3-12 


□ Evaluator has solved the item 


Section 1: The item must meet all of the following to be considered further. 


Item / Task Evidence Rating 


1A Alignment: Is the item directly and accurately aligned to the assessment target and 
Standard(s) indicated, including the Standards for Mathematical Practice(s) listed? 

□ Yes 

□ No 

□ 

Revised 

IB Correctness: Is the item mathematically correct, including at least one appropriate solution 
and accurate use of mathematical vocabulary and symbols? 

□ Yes 

□ No 

□ 

Revised 

1C Rationales and/or Top-Score Response: For a selected-response item (SR), are high-quality 
rationales (aligned to the assessment targets and Standard(s)) provided for the correct answer and 
each distractor? For a constructed-response item (CR), is a top-score response provided? 

□ Yes 

□ No 

□ 

Revised 

ID Grade Appropriateness: Does the item reflect the coherence of the Standards by using 
appropriate mathematical vocabulary, numbers, and symbols for the grade or course? 

□ Yes 

□ No 

□ 

Revised 


If the item does not meet all of the criteria above and cannot be revised to do so, remove the item from consideration. 
Otherwise, proceed to the second section. 


Published v.2 201 4 - send feedback to info@studentsachieve.net Reviewer Initials: 


Title of Program: 


324 


Criteria for Evaluating Items for Common Core 
State Standards-Aligned Assessments 


SECTION 5 

Assessment Item Quality Criteria Checklist 

Mathematics, Grades 3-12 


Section 2: Items that pass the first gate must next meet the following criteria, possibly after revision. 

Item / Task Evidence Rating 


2A Linguistic Clarity: Is the written text of an item clear, unambiguous, and appropriate for the 
grade level with no construct-irrelevant linguistic complexity (e.g., negative phrasings, complex 
sentence structures)? 


□ Yes | | Revised 

D No Q N/A 


2B Technical Quality: Does the item clearly communicate the expectation, preclude guessing, 
and refrain from clueing a student’s response strategy? 

□ Yes 

□ No 

□ 

□ 

Revised 

N/A 

2C Accessibility: Is the item accessible, reflecting Universal Design for Learning (UDL) 
principles to maximize accessibility for ELL students and students with disabilities? 

□ Yes 

□ 

Revised 

□ No 

□ 

N/A 

2D Technology: If technology is used, is it clear, is it easily used by the students, does it 
improve measurement of the construct, and does it represent real-life use of technology, 

□ Yes 

□ No 

□ 

Revised 

where applicable? 

□ 

N/A 
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Criteria for Evaluating Items for Common Core 
State Standards-Aligned Assessments 


SECTION 5 

Assessment Item Quality Criteria Checklist 

Mathematics, Grades 3-12 


Item / Task 


Evidence 


Rating 


2E Complexity: Does the item align to the intended complexity required by the assessment 
claim and Standard® being assessed, without any needless complexity or difficulty? 


□ Yes Revised 

] No Q N/A 


2F Context Quality: When a situational or real-world context is present for the item, is the 
context logical, grade appropriate, and necessary to assess the Standard? 


□ Yes □ Revised 

D No Q N/A 


2G Stimuli: Are diagrams, pictures, or illustrations, clear, purposeful, and consistent with 
UDL principles? 


□ Yes □ Revised 

D No Q N/A 


2H Rubric: For open-ended items, are rubrics clear, aligned to the assessment target, and 
valid for all solution paths? 


□ Yes | | Revised 

□ No Q N/A 


Published v.2 2014 - send feedback to info@studentsachieve.net 
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Section 6 


Additional Resources 
for Evaluating Alignment 
of Instructional Materials 

Achieve Open Educational Resource Rubrics 

Qualitative Measures Rubric for Informational Text and Qualitative Measures for Literature 
CCSS Grade Bands and Quantitative Measure 
Illustrative Mathematics Task Review Tool 


Additional Resources for Evaluating 
Alignment of Instructional Materials 


Achieve Open Educational Resource 
(OER) Rubrics 

Open Educational Resources (OER) are instructional materials, often 
in a digital and online format, that contain an open copyright license 
that allows educators to share, reuse and edit these materials. The 
OER Rubrics can be used in developing or evaluating OER to help 
determine the degree of alignment of OER to the CCSS, and to 
determine aspects of quality of OER. OER range from a single lesson 
or instructional support material (such as a problem set or game) to a 
complete unit or set of support materials. 

To view and download, please visit: 
http://www.achieve.org/oer-rubrics 


Qualitative Measures Rubric for Informational 
Text and Qualitative Measures Rubric for 
Literature 

Developed by the Council of Chief State School Officer’s English 
Language Arts state collaborative to support qualitative analysis of 
what makes a given text complex, these qualitative rubrics guide 
educators in measuring features of text complexity, such as: text, 
structure, language clarity and conventions, knowledge demands, 
and levels of meaning and purpose. 

To view and download, please visit: 
http://achievethecore.org/qualitative-measures or 
www.ccsso.org/textcomplexity 


Published v.2 201 4 - send feedback to info@studentsachieve.net Reviewer Initials: 


CCSS Grade Bands and 
Quantitative Measures 


A step-by-step guide to accessing free, online tools that identify the 
appropriate grade band for a text. 

To view and download, please visit: 
www.achievethecore.org/quantitive-measures 


Illustrative Mathematics Task Review Tool 

The Illustrative Mathematics task review criteria are used to evaluate 
K-12 mathematics tasks designed specifically to illustrate the CCSSM 
and intended for inclusion on the Illustrative mathematics website 
(http://www.illustrativemathematics.org/). Each task is intended to 
be part of a highly crafted set that illustrates the breadth, depth and 
nuances of each standard, cluster, domain, grade level, or conceptual 
category in the standards. In order to be published at Illustrative 
Mathematics, a task must meet all eight criteria described in the 
review form. 

To view and download, please visit: 
http://bit.ly/1q8vvEr 
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Section 7 


Appendix: The Publishers 
Criteria for the Common 
Core State Standards 

330 ELA/Literacy, Grades K-2 
340 ELA/Literacy, Grades 3-12 
360 Mathematics, Grades K-8 
383 Mathematics, High School 


Appendix: The Publishers’ 
Criteria for the Common 
Core State Standards 

ELA/Literacy, Grades K-2 
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requirement that students' reading material be substantive and linked in meaningful ways to 
content area learning. They also include a more in-depth approach to vocabulary development 
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guide publishers and curriculum developers as they work to strengthen existing programs and 
ensure alignment of materials with the Standards to provide a clear and consistent framework. 
The standards are the product of a state-led effort coordinated by the National Governors 
Association Center for Best Practices and the Council of Chief State School Officers and were 
developed in collaboration with states, teachers, school administrators, and content experts. 
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patterns to words not previously seen or studied. Because students differ widely in how 
much exposure and practice they need to master foundational skills, materials also need 
to incorporate high-quality activities for those students who are able to reach facility with 


curriculum developers. The measures are based on the principles laid out in Appendix A and have been further developed and refined. These 
criteria recognize the critical role that teachers play in text selection. 


> 

= £ 

‘ <L O 


§=-§ 


£ 3 
<’ 3 


fD O 

■D 3 

00 73 

£ ™ 
— • X 
Q_ =; 


N> 


10 


0 

n 

Q 

? 

c 

3 

CO 

rD_ 

O 

3 

■0 


8- 

03 

n 

r- +■ 

a> 

X 




t— t- 

ft) 

•"+ 

3 

< 


to 

crq 

0 

5 

3‘ 

r+ 

=r 

03 

t t 

QJ 

3 

r f 

n 

cr 

~n 

? 

03 

03 

QJ 
— s 

a 

>■ 

X 

1 — t- 

3 


to 


a §■ 

to «8 

7 § 

CO 

£ ° 

CL Q 


rD 

13 

c r 

rD 

cs' 

CL 

CL) 

— t 

rD 

era 

<' 

rD 

o 

33_ 

< 


S 

C3- 

TO 

la- 

s’ 

3- 

O 

I? 

3 

TO 

3 

TO 

O 

"3 

"3 

O 

£ 

c 

3 


TO 

3 

TO 

o 

c 

3 

to 

TO 

TO 


— ID TO 


^ rD 

ft Q- 

C QJ 
Q- 3 
rD q_ 

ft O 

CO ^ 

rD 

rD -s 

QJ CO 

cl era 

c 

M dl 

QJ 

n 

rD 


n 

o 

3 

3 

o 

n 
o 
— ? 
rD 

LO 

r-t 

QJ 

r— (■ 

rD 

on 

r—f 

QJ 

=3 

Q_ 

QJ 


O crq 

r+ < 

rD rD 

QJ CO 

3- ET 


QJ 

=3 

Q_ 

n 

c 


n 

c_ 

c 

3 

Q_ 

rD 

< 

rD_ 

o 

■D 

rD 


QJ 


13 

— h 

o 

— s 

3 

QJ 

r-t- 

o' 

=3 

o 

=3 


n 

O 

3 

"0_ 

ru 

X 


o 

Q_ 

rD 

3 

o 

13 

CO 


o 

o_ 

QJ 

=3 

Q_ 


o 

U 


*< =K 

qj rD 

r—t 

< UO 

1 rD 
0Q_ 
I3 - 
3_ 
I3 - 

crq 


rD 
13 

Crq 


QJ 

=3 Q_ 
rD rD 
fD 


rD 

QJ 

Q_ 

Z3 - 

crq 

on 


QJ 
=3 
Q_ 
rD QJ 

=5 O 
■O ~ 


n 
o 
— ? 
rD 
On 


Q- 7+ 
ru rD 

£ » 


QJ 

=3 

Q_ 

QJ 


=3 

crq 

rD 


QJ 

13 

Q_ 


=3 

crq 

QJ 
■D 
T3 
— \ 
o 

T3 


5' % 

R =f 

3 ■< 

tD O 

|l 

CL S’ 


5 

‘S' 

TO 

TO 

Q 

TO 

3- 

«5 

3 

6 


3 


' u KT 

— o < 

=3 


QJ 
=3 

crq 

c 

QJ 

crq rD 


c 

Q_ 


n 

0 
3 
n 
rD 
"O 

r+ 

c 

QJ_ 

*- £ 

1 " 

§ tD 
tD % 

Q l/) 

era qj 


3- 

TO 

3 

-Q 

C 

TO 

3 

TO 

3 

In 

O 

C 


3 

TO 

Q. 


3- 

TO 

m 

Q 

3 

& 

& 


crq rD 

3 n 

Q_ O 

n> 3 
3 
o 

3 


C 

Q_ 

rD 

3 


n 
QJ 
3 
— s 

rD 

QJ 

Q_ 

o 

3 


n 

O 

3 

"0_ 

ru 

X 

3 

QJ 


n 

c_ 

c 

3 

3 

QJ 


CT 

rD 


n 

O 

3 

~g_ 

rD 

x 


QJ 

cr 

o 

< 

rD 


rD 

QJ 

Q_ 


fD £ 
3 H3 

CO CO 

rD r+ 


< 

03 


O ^ 


O l JL 
rD 
n 


O 

c 


cr 

rD 


QJ 0) 

O 3 


C 

Q_ 


qj rD 

— QJ 

3 

QJ O 
3 =5 


rD rD 
n o 

§ i 

^ =5 


0) 

QJ QJ 

Q_ 


rD 
crq 
rD q] 


qj 

c/3 crq 
<-*■ rD 

Q- ft 

rD c 

3 Q_ 


fD (7 
QJ ^ 

3- O 


7s- 

3 

o 


3 

3 O 

QJ 3 

n 

O 

3 

7s“ "E_ 
0) 03 


03 

QJ 


*< 

QJ 

3 

Q_ 


3 3 


03 

Q_ 


3 

QJ 

Q_ 

Q_ 

r-t- 

o‘ 

3 


C 

Q_ 

03 

3 


3 

crq 


03 

QJ 

Q_ 

r—h 

ru 

x 


03 rD 
7s 

CO I 

r+ NJ 
O — 


□. Q_ O 


03 

Q_ 

crq 

03 


O 

c 

crq 


QJ 
3 
Q_ 

QJ QJ 

Q_ -s 


O 

"O 

~o 

o 

r+ 

c 

3 


QJ 

n 


03 03 

QJ — • 3" 

~5 03 _ 


3 

"D_ 

ft- c* fD 


n 

O 

3 

— h 

— S 

o 

3 

r—t 

QJ 

3 

Q_ 

n 

O 

3 

"O 


fD QJ 
3 on 
O- M - 
crq fD 


QJ 

Q_ 

rp 

Fd" 

< 

03 


03 

3 

03 

03 

Q_ 

r—h 

o 

"O 
— s 

0 
< 

01 

03 


< 

rp_ 

o 

T3 


c 

Q_ 

03 

3 


03 

3 


C 

Q_ 

03 

3 


n 

O 

3 

03 CO 

O 

3 

03 


03 

Q_ 


3 =T 
QJ q- 

— ? 03 

QJ crq 


3 

3 

3’ 

crq 


< 

03 
n 
O 

3- 03 

rD qj 
3 Q_ 
r* 03 


- s 

° Q. 
CL ' 
tD CL) 


TO =T era O 


o 

C 

Q_ 

n 

O 

3 


crq crq 

"* QJ 
crq 

03 
n 
O 

3 

■o 


03 

QJ 

Q. 

3’ 

crq 

— h 
QJ 

n 


QJ_ 

ol 


c 

Q_ 

03 

3 


o 

c 


cr =r 
03 o 
era rD 


Q_ 

03 

Q_ 

3" 

r+ 

o 


03 

QJ 

Q. 

3’ 

crq 

O 

— h 

03 

< 

03 

3 


03 

n 

o 

3 

3 

o 

3 

n 

o 


03 

(/) 

r+ 

03 QJ 


£= 

n 

r~t ~ 

o' 

3 

ro 

< 

03 

3 


& « 

03 3 

=5 

r—h CD 
CO crq 


O 

c _ 

crq QJ 


cr rt 
03 03 


03 

QJ 

Q. 

3 ’ 

crq 


03 

(/) 

l—t 

QJ 

3 

Q_ 

QJ 


■O 

o 


o 

3 

era 

< 


QJ 
— s 
CL 


C 

Q_ 

03 

3 

r—t 

CO 


n 

QJ 

3 

—s 

03 

QJ 

Q_ 


03 

3 

C 

n 

3" 

3 

o 


03 

QJ 

Q. 

3’ 

crq 


7T 

rp_ 

< 


03 

QJ 

Q_ 


n 

n 

C/3 

C/3 


o 

3 

crq 


o 

3 ’ 


x: o 

— - — h 

E Q 

3 — 

r-t- VJM 

N) 0) ^ 
? r+ 

TO "O 
“ 0) - 
cl n 

W TO 
Q. QJ 

q? f? 

QJ 

S 

— 03 Co 

3 CO 


03 


n 

0 
3 

01 

03 

3 


— h 

o 


03 

QJ 

Q_ 

3 ’ 

qq 

QJ 

3 

Q_ 


£= 

Q_ 

03 

3 


n 

O 

3 


03 

QJ 

Q_ 


Q_ 

QJ 


03 

X 


cr 

QJ 


QJ 
— s 
03 


7s 

rt> 

< 

n 

r+ 

rD 

0)' 

“+» 

o 


n> 

x 


n> 


U1 


n> 

o 

ft 

o' 

3 

V) 


3 

crq 


03 

3 

— h 

c 

03 

3 

n 

•< 


O ^ =r 


03 

QJ 

3 

Q_ 

< 

QJ_ 

ol 

3 

03 

r— f 

3" 

o 

Q_ 

co 

n 

c 

— s 
03 
3 

t— f 
< 
QJ 
< 
QJ_ 

oT 

cr 


QJ 

3 

Q_ 

r— f 

o 

o 


cr 

rD_ 

3 ’ 

crq 


03 

Q_ 

< 

o 

n 

QJ 

cr 

c 


*< 

Q_ 

03 

< 

rp_ 

o 

T3 

3 

03 

3 


3 

n_ 

c 

Q_ 

3 


03 

3 

"D 


— ■ QJ 


5 

Q 

a 

CO CQ 


o < 


03 

Q_ 

cr 

•< 


03 

Q_ 


2.TD “ “ 


cr 

03 


03 

Q_ 


03 

Q_ 


< 

03 

cr 

03 

3 

n 

3“ 

3 

QJ 


0 

QJ 

—5 

r— f 

— \ 

03 

03 

— s 

n 

Qj’ 

O 


— s 

iTT 

Q_ 

CO 

7T 

3" 

03 

O 

03 

C 

■D 

Q_ 

3' 

crq 

O 

— h 

QJ 

— h 

03 

3 


Q_ 

— h 


— s 

— h 

o_ 

03 

_Q 

0 

S 

£= 

03 

3 


r— f 

c 

■p 

QJ 

3 

H 

Q_ 

3" 

03 

03 

QJ 

CO 

CO 

03 

~ 

CO 

•< 

3 - 

— ■ 

0 

3 

c 

■0 

Q_ 

03 

5’ 

3 

n_ 

03 


3 

c 

r-t- 

Q_ 

03 

03 

Q_ 

QJ 

QJ 

— h 
— S 

CO 

CO 

QJ 

03 

3 

CO 

CO 

tD 

3 

S 

03 

0 

3 

— s 

r—t 

7T 

CO 


QJ 

3 

Q_ 


— O 


™ ™ n- : 


s > 

p- ft 

<■ 


Q 

cr 


CO lo 
r- ^ 

ft) 

ft ** 

03 to 
“■ 2 
TO 
3 

TO- 

O 
■CS 
T3 
O 
TO 
TO 

c 

3 


TO 

m 


3- 

Q 


2 
TO 
Q 
^ 10 
< C 
CL TO 
tD 


T3 

0 2 
rD iq 

S S 
z IS 


QJ 

3 

Q_ 

QJ 


3* 

ft) 

'S' 


w 3 

SJ o 

03 Cf 

cr §’ 

2. 3 

TO ^ 


for students to learn the words' meanings on their own, providing such things as student- 
friendly definitions for high-frequency words whose meanings cannot be inferred from the 
context. 


Additional materials aim to increase the regular independent reading of texts that 
appeal to students' interests while developing both their knowledge base and joy in 
reading. These materials should ensure that all students have daily opportunities to read 
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Student background knowledge and experiences can illuminate the reading but should not 
replace attention to the text itself. Questions and tasks should require thinking about the 
text carefully and finding evidence in the text itself to support the response. Discussion 
tasks, activities, questions, and writings following readings should draw on a full range of 
insights and knowledge contained in the text in terms of both content and language. 
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texts of their choice on their own during and outside of the school day. Students need 
access to a wide range of materials on a variety of topics and genres both in their 
classrooms and in their school libraries to ensure that they have opportunities to 
independently read broadly and widely to build their knowledge, experience, and joy in 
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When necessary, extra textual scaffolding prior to and during the first read should focus 
on words and concepts that are essential to a basic understanding and that students are 
not likely to know or be able to determine from context. Supports should be designed to 
serve a wide range of readers, including those English language learners and other 
students who are especially challenged by the complex text before them. Texts and the 
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Materials provide opportunities for students to build knowledge through close reading 
of specific texts (including read-alouds). Materials should design opportunities for careful 
reading of selected passages or texts and create a series of questions that demonstrate 
how close attention to those readings allows students to gather evidence and build 


that already have a research base should build on that base by continuing to monitor their efficacy 
with the whole range of Common Core State Standards. 
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1 A working group has developed clear, common standards for measuring text complexity that are consistent across different curricula 
and publishers. These measures blend quantitative and qualitative factors and are being widely shared and made available to 
publishers and curriculum developers. The measures are based on the principles laid out in Appendix A and have been further 
developed and refined. These criteria recognize the critical role that teachers play in text selection. 
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students encountering appropriately complex texts at each grade level to develop the 
mature language skills and the conceptual knowledge they need for success in school 
and life. Instructional materials should also offer advanced texts to provide students 
at every grade with the opportunity to read texts beyond their current grade level to 
prepare them for the challenges of more complex text. 
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Additional materials aim to increase regular independent reading of texts that 
appeal to students' interests while developing both their knowledge base and joy in 
reading. These materials should ensure that all students have daily opportunities to 
read texts of their choice on their own during and outside of the school day. Students 
need access to a wide range of materials on a variety of topics and genres both in 
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age-appropriate materials to ensure that they receive the extensive training and 
practice in the foundational reading skills required to achieve fluency and 
comprehension. The K-2 publishers' criteria more fully articulate the essential 
foundational skills all students need to decode to become fluent readers and 
comprehend text. 


^The note on the range and content of student reading in K-5 (p. 10) states: "By reading texts in history/social studies, science, and 
other disciplines, students build a foundation of knowledge in these fields that will also give them background knowledge to be better 
readers in all content areas in later grades. Students can only gain this foundation when the curriculum is intentionally and coherently 
structured to develop rich content knowledge within and across grades." 
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each text. Though there is a productive role for good general questions for teachers 
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High-Quality Text-Dependent Questions and Tasks: Among the highest priorities of the 
Common Core State Standards is that students be able to read closely and gain knowledge 
from texts. 
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Specific texts or text types named in the standards are included. At specific points, 
the Common Core State Standards require certain texts or types of texts. In grades 9- 
12, foundational documents from American history, selections from American 
literature and world literature, a play by Shakespeare, and an American drama are all 
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and students to have at hand, materials should not over rely on "cookie-cutter" 
questions that could be asked of any text, such as "What is the main idea? Provide 
three supporting details." Materials should develop sequences of individually crafted 
questions that draw students and teachers into an exploration of the text or texts at 
hand. 


State Standards. However, the scaffolding should not preempt or replace the text by 
translating its contents for students or telling students what they are going to learn in 
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challenge that knowledge? As students apply knowledge and concepts gained through 
reading to build a more coherent understanding of a subject, productive connections 
and comparisons across texts and ideas should bring students back to careful reading 
of specific texts. Students can and should make connections between texts, but this 
activity should not supersede the close examination of each specific text. 
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random but should build toward more coherent understanding and analysis. Care 
should be taken that initial questions are not so overly broad and general that they 
pull students away from an in-depth encounter with the specific text or texts; rather. 


way to elicit this active engagement. Students should have opportunities to use 
writing to clarify, examine, and organize their own thinking, so reading materials 
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learners and other students who are especially challenged by the complex text before 
them. Texts and the discussion questions should be selected and ordered so that they 
bootstrap onto each other and promote deep thinking and substantive engagement 
with the text. 
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advance of reading the text; the scaffolding should not become an alternate, simpler 
source of information that diminishes the need for students to read the text itself 
carefully. Effective scaffolding aligned with the standards should result in the reader 


Materials focus on academic vocabulary prevalent in complex texts throughout reading, 
writing, listening, and speaking instruction. Academic vocabulary (described in more 
detail as Tier 2 words in Appendix A of the Common Core State Standards) includes those 
words that readers will find in all types of complex texts from different disciplines. 
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Sometimes curricula ignore these words and pay attention only to the technical words 
that are unique to a discipline. Materials aligned with the Common Core State Standards 
should help students acquire knowledge of general academic vocabulary because these 
are the words that will help them access a wide range of complex texts. 
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In middle school, 35 percent of student writing should be to write arguments, 35 
percent should be to explain/inform, and 30 percent should be narrative. 

In high school, 40 percent of student writing should be to write arguments, 40 percent 
should be to explain/inform, and 20 percent should be narrative. 


REVISED 4 / 12/2012 


GO 

Ul 

GO 


QJ 

n 

r-t- 

c 

QJ 


QJ 

O 

Q_ 


o rD 

QJ Ui 


3 3 


3- 


QJ 


QJ 


£ — 
— QJ 


-• Ul 

~o 

o 

_ Ul 
ui ui 


cr 

rD 

QJ 

Ul 

Ul 

rD 

Ul 

Ul 

rD 

Q_ 

QJ 

O 

Q_ 


rD 
o 
era 
ID QJ 

-i era 

a/ 2 
i/i 3 
rD 

> 2 . 

era 


rD 

< 

CL 

rD 

o 

n 

rD 


cr 

rD 


ui rD 


rD 

QJ 

r-t- 

CL 

rD 

QJ 


S "i. 

=5" Z3 

r+ era 


"O 

c 

cr 


=r c 


o o 


CL 

rD 

T 

QJ 

O 

era 

rD 


_ 7T 
Ul’ Ul 


O 

c 


qj n 
n 
n 
rD 


_Q 

2 r6 


o 

< 

rD 

CL 

o 

< 

rD 


c 

CL 

rD 

o 


o 

< 

CL 

rD 


cr 

rD 

cr 

QJ 

Ul 

fD 

CL 

O 

O 


QJ 


rD 

Ul 

r-t- 

c 

CL 

rD 

o 


CL 
rD 

Ul 

era’ era 

S 3 

CL S 


Ul 


n_ 

33 fD 


rD 

QJ 


O c 


=r 3 


n_ 

c 

Q. 

= 3 ’ 

era 

m 

=3 

era 


rD qj 

< 


rD 


QJ 

o 

CL 
CL 

— • fD QJ fD 

- ^ fD 

I* 


3 

CL 


fD 

ui 

Ul 

r-t- 

c 

CL 

fD 

O 


O 

era 


3 ^ 


CL 

rD 

< 

rD 


CL 

Ul 


— ^ QJ O 

=3 ^ 
rD 


QJ 

=3 

era 

c 

QJ 

era 

rD 

fD" 

QJ 

rD 


cr 

rD o' 

cr -« 
qj =r 
£ o 

S. § 
o S 

3 rD 
5 fD 
-• =£ 
Q_ ~ 
fD ^ 
QJ 


CL 

QJ 


cr 

< 

o 

fD 

n 

fD 


c 

n 


ro K - 


o 

< 

o 

7T 

fD 


rD 

3 

o 

ui 


O 

fD 

CL 


•< ^ 

O 

_ CL 

cr r-t- c 
fD J n 


CL 

n 


O 

c 


? 3 

QJ QJ 


ft) QJ. 
n 1/1 


3 < 

QJ m 
n QJ 

S a 

ID 2 

s 

QJ 
O 
CL 
CL 
O 
n 
c 

3 

fD 
O 

r+ 

fD 
CL 

CD "i 
Ui fD 
ui ui 

r+ 0) 

O QJ 


qj =r 

EL cr 

s - 

5 ^ fD 
fD , 
fD =! 


fD 

3 

o 

Ul 


*< S Q. O z 


o 

n 

rD 


o 
c 

^ era 
S, =r 

r-f QJ 

n 

rp_ £ 

"V QJ 


n> J < 

< fD fD 


cr 

c 


era -q 
fD o 


fD 

QJ 

Q_ 

o’ 

fD 


conclusion: efficacy of aligned materials 


UJ 


Ul 

"D 

fD 

QJ 

o’ 

era 

QJ 

o 

Q_ 


3 

era 


fD 

X 

"D 


n H) Q. fD 


ui O 
O =3 

Ul 

=5 Qj 

Q_ ui 

n* cL 
qj =r 

r+ fD 
fD -< 

Is 

ft T 3 

C — • 


< CL 

QJ 

=3 =3 

~o 

n 
fD 
Q_ 


fD 

n 


3 

QJ_ 

"O 

c 

—5 

■a 

o 

Ul 

fD 


CL 

fD 

O 

r-t- 

Ul 

Ul 

=T 

o 

c_ 

CL 

QJ 


3 
n 
—1 
fD 
QJ 
Ui 

o’ 

o_ era 

=r -< 

fD ui 

3 -g 


< 13 

fD. era 
■< era 
£ qj 

I » 

GO ui 

o • 


ft C 

c y> 

CL 
fD 

3. era 

^ =3 

3 fD 
CL 


n 

o 

3 

3 

c 

o. 

n’ 

Q) 


QJ 


QJ 
Ul -3 

cr =5 

fD QJ 


fD 

^ -h Q)' 

U) r+ — 


fD 
QJ 

QJ 

fD zs 
fD Q- 

-D 

^ O 
fD < 
n ^ 
eD 
fD 

^ E 

0 < 

— s 

fD — 
r+ 3 

3 . QJ 

=3 CL 

QJ Q- 

=5 r+ 

Q- o' 

-h =5 

c 


QJ QJ 

s s- 

1 £ 
C QJ 

Ul r+ 

=r fD 
u> ^ 
r+ =3 

c QJ 

CL Ui 
§ fD 

ft ^ 

ui ^ 

r+ O 

O -h 

r-h 

fD = 5 " 
Qj fD 

3 « 

Ul 


§ 

o 

(D 

3. 

Q 


irt 

to 

ST 3 

3 cr 

CL ^ 
QJ Q 


<. 3 


qj fD 
— CL 


n n 

I - 

< f— t- 

fD fD 
O X 

r-t- f— t- 

o' ^ 

^ 5 l 

QJ fD 
O 


fD 

— h 

c_ 

— s 
QJ 
C3 

era 

fD 

o 

— h 

era 

QJ 


o 

£ 

r-t- 

o 

QJ 

"O 


era 

c 


fD 


CL 

Ul 

T3 
— 5 
O 
< 
CL 
fD 
QJ 

— h 

o 

n 

c 

Ul 


8 

03 


O 

Ul 

*-* 

Ul 

, 

3 

s 

n’ 

Q 

S 


O 

c_ 

CL 

Q_ 

fD 

3 

o 


3 g 
ft ^ 

fD & 


fD 


fD 

< 


fD 

< 


O fD 

rD cr. 

< C3 

o_ era 

O fD 
-a eu 
n 

Sr ^ 

= •< 

1/1 2 
QJ 

Q_ _ 

era 

c 

CS CD 
CL Q- 
fD ID 

S w 

r-t- TI3 
QJ fD 
o n 
CL 

5' Cl 

era 

Ul 


QJ QJ 

era q_ 

fD u ~ 

qj S 

ui 

QJ r-t;' 


fD 

o 

QJ 

O 

CL 


=3 (Q 

Ul ^ 

=T § 

£ 3 

i 3 

o Q 

fD § 

111 2 

n Q. 

H 

r+ O 

O IQ 


fD 

s, s 

2 ° 
QJ fD 


ui m 

O C3 

<5. 

ro ^ 
< . 
n _) 
qj =r 
3 fD 
< 


a i 


C3 g 
ui O 

c S 

fD fD 


O 

3 

Ul 


c 

CL 

fD 

O 


era 

QJ 


fD fD 
X 
"O 


o 
era 

qj 3 
era eD 

— . Ul 


o 

era 


Ul 

C3* 

era 

CL 

fD 


ui 

O 


fD 

X 


QJ 

r-t- 

CT 

fD 


QJ 

O 

cr 

fD 

n 

O 

3 

o’ 

era 


QJ 

n 


O 

o 


fD 

"D_ 

QJ 

n 

fD 

3 

fD 

O 


Ul 

— h 

=r 

O 

c 

—5 

0 

3 

CL 

r+ 


=T 

C 

fD 

Ul 


fD 

Ul 

n 

3 


c 

"o’ 

r-t- 

r-t- 


3 


fD 

QJ 

CL 

r+ 

fD 

Qj’ 


QJ 

Qj’ 

O 

Ul 

CL 

QJ 

r-t- 



fD 

era 

n 

0 

=r 

fD 

0 

CL 

O 

O 

£ 

era 

< 

r-t- 

=T 



r+ 

0 

=j- 

QJ 

fD 

§ 

n 

0 

QJ 

< 

3 

r+ 

3 

=T 

QJ 

r-t- 

0 

13 

fD 

n 

O 

0 

era 

— s 

QJ 

fD 

era 

l/l 

fD 

r-t- 

Ul 

QJ 


r+ 

Ul 

r+ 

fD 

c 

cn 

CL 

r+ 

fD 

Q) 


13 

r-t- 

CL 

Ul 

QJ 



-1 

O 

CL 


fD 

— i 

fD 


O 

CL 

C 

n 

r-t- 

o’ 

o 


-• o 


Ul 

QJ 


fD 

Ul 


fD 

QJ 

n 

=r 


o 

CL 

c 

n 

r-t- 

o’ 

o 


QJ 

cr 

Ul 

O 


era 

o 


T3 
( u -1 
^5 fD 
fD r+ 
-h Ul 

9: fD 
3 <. 

CL 

fD 

O 

n 

fD 


Materials use multimedia and technology to deepen attention to evidence and texts. 

The Common Core State Standards require students to compare the knowledge they gain 
from reading texts to the knowledge they gain from other multimedia sources, such as 
video. The Standards for Reading Literature specifically require students to observe 


and publishers. These measures blend quantitative and qualitative factors and are being widely shared and made available to 
publishers and curriculum developers. The measures are based on the principles laid out in Appendix A and have been further 
developed and refined. These criteria recognize the critical role that teachers play in text selection. 
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History/Social Studies, Science, and 
Technical Subjects Literacy Curricula, 
Grades 6-12 


gain from quantitative data with information they gain from a single or multiple 
written text sources. Therefore, materials aligned with the Common Core State 
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All students (including those who are behind) have extensive opportunities to 
encounter grade-level complex text. Far too often, students who have fallen behind 
are only given less complex texts rather than the support they need to read texts at 
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Standards might require students to compare their own experimental results to 
results about which they have read, and integrate information from video or other 
media with what they learn from text. 


Design for whole-group, small-group, and individual instruction cultivates student 
responsibility and independence. It is essential that questions, tasks, and activities are 
designed to ensure that all students are actively engaged in reading. Materials should 
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demonstrate their independent capacity to read at the appropriate level of complexity 
and depth. Aligned materials therefore should guide teachers to provide scaffolding to 
students but also gradually remove those supports by including tasks that require 
students to demonstrate their independent capacity to read and write in every domain at 
the appropriate level of complexity and sophistication. 
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is equally crucial when dealing with larger volumes of text for research or other 
purposes. 
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provide opportunities for students to participate in real, substantive discussions that 
require them to respond directly to the ideas of their peers. Teachers can begin by 
asking the kind and level of questions appropriate to the reading and then students 
should be prompted to ask high-quality questions about what they are reading to 
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The strong focus of the Standards in early grades is arithmetic along with the components of 
measurement that support it. That includes the concepts underlying arithmetic, the skills of 
arithmetic computation, and the ability to apply arithmetic to solve problems and put arithmetic to 
engaging uses. Arithmetic in the K-5 standards is an important life skill, as well as a thinking subject 
and a rehearsal for algebra in the middle grades. 
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conceptual understanding, procedural skill and fluency, and the ability to apply mathematics to solve 
problems. Thus, the implications of the standards for mathematics education could be summarized 
briefly as follows: 
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Both of the assessment consortia have made the focus, coherence, and rigor of the Standards central 
to their assessment designs. 3 Choosing materials that also embody the Standards will be essential for 
giving teachers and students the tools they need to build a strong mathematical foundation and 
succeed on the coming aligned exams. 
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expressions with letters and later still the study of polynomials. As the application of the properties is 
extended over the grades, an understanding of how the properties of operations work together 
should deepen and develop into one of the most fundamental insights into algebra. The natural 
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Informing purchases and adoptions. Schools or districts evaluating materials and tools for 
purchase can use the criteria to test claims of alignment. States reviewing materials and tools 
for adoption can incorporate these criteria into their rubrics. Publishers currently modifying 
their programs, or designing new materials and tools, can use the criteria to shape these 
projects. 


number of criteria. Instead, the criteria use the Standards' focus, coherence, and rigor as the main 
themes. In addition, this document includes a section on indicators of quality in materials and tools, as 
well as a criterion for the mathematics and statistics in instructional resources for science and technical 
subjects. Note that the criteria apply to materials and tools, not to teachers or teaching. 
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Criteria for Materials and Tools Aligned to the Standards 
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Thus, an over-arching criterion for materials and tools is that they provide supports for special 
populations such as students with disabilities, English language learners , 7 and gifted students. 
Designers of materials should consult accepted guidelines for providing these supports. 


All students must have the opportunity to learn and meet the same high standards if they are to access 
the knowledge and skills necessary in their post-school lives. The Standards should be read as allowing 
for the widest possible range of students to participate fully from the outset, along with appropriate 
accommodations to ensure maximum participation of students with special education needs. 
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In all these cases, it is recommended that the criteria for focus be attended to first. By attending first to 
focus, coherence and rigor may realistically develop. 
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Table 1. Progress to Algebra in Grades K-8 


Know number 
names and the 
count sequence 

Count to tell the 
number of objects 

Represent and 
solve problems 
involving addition 
and subtraction 

Understand and 



apply properties 

Represent and 

Compare numbers 

of operations and 

solve problems 


the relationship 

involving addition 

Understand 

between addition 

and subtraction 

addition as 

and subtraction 


putting together 


Add and subtract 

and adding to. 

Add and subtract 

within 20 

and understand 

within 20 


subtraction as 


Understand place 

taking apart and 

Work with 

value 

taking from 

addition and 



subtraction 

Use place value 

Work with 

equations 

understanding 

numbers 11-19 to 

Extend the 

and properties of 

gain foundations 

counting 

operations to add 

for place value 

sequence 

and subtract 
Measure and 


Understand place 

estimate lengths 


value 

in standard units 


Use place value 

Relate addition 


understanding 

and subtraction to 


and properties of 
operations to add 
and subtract 
Measure lengths 
indirectly and by 
iterating length 
units 

length 


Represent & solve 

problems 

involving 

multiplication and 
division 

Understand 
properties of 
multiplication and 
the relationship 
between 

multiplication and 
division 

Multiply & divide 
within 100 

Solve problems 
involving the four 
operations, and 
identify & explain 
patterns in 
arithmetic 

Develop 

understanding of 
fractions as 
numbers 

Solve problems 
involving 

measurement and 
estimation of 
intervals of time, 
liquid volumes, & 
masses of objects 

Geometric 
measurement: 
understand 
concepts of 
area and relate 
area to 

multiplication and 
to addition 


Use the four 
operations with 
whole numbers to 
solve problems 

Generalize place 
value 

understanding for 
multi-digit whole 
numbers 

Use place value 
understanding 
and properties of 
operations to 
perform multi- 
digit arithmetic 

Extend 

understanding of 
fraction 

equivalence and 
ordering 

Build fractions 
from unit 
fractions by 
applying and 
extending 
previous 

understandings of 
operations 

Understand 
decimal notation 
for fractions, and 
compare decimal 
fractions 


Understand the 
place value 
system 

Perform 
operations with 
multi-digit whole 
numbers and 
decimals to 
hundredths 

Use equivalent 
fractions as a 
strategy to add 
and subtract 
fractions 

Apply and extend 
previous 

understandings of 
multiplication and 
division to 
multiply and 
divide fractions 

Geometric 
measurement: 
understand 
concepts of 
volume and relate 
volume to 
multiplication and 
to addition 

Graph points in 
the coordinate 
plane to solve 
real-world and 
mathematical 
problems* 


Apply and extend 
previous 

understandings of 
multiplication and 
division to divide 
fractions by 
fractions 

Apply and extend 
previous 

understandings of 
numbers to the 
system of rational 
numbers 

Understand ratio 
concepts and use 
ratio reasoning to 
solve problems 

Apply and extend 
previous 

understandings of 
arithmetic to 
algebraic 
expressions 

Reason about and 
solve one-variable 
equations and 
inequalities 

Represent and 

analyze 

quantitative 

relationships 

between 

dependent and 

independent 

variables 


Apply and extend 
previous 

understanding of 
operations with 
fractions to add, 
subtract, multiply, 
and divide rational 
numbers 

Analyze 
proportional 
relationship and 
use them to solve 
real-world and 
mathematical 
problems 

Use properties of 
operations to 
generate 
equivalent 
expressions 

Solve real-life and 
mathematical 
problems using 
numerical and 
algebraic 
expressions and 
equations 


Work with radical 
and integer 
exponents 

Understand the 

connections 

between 

proportional 

relationships, 

lines, and linear 

equations** 

Analyze and solve 
linear equations 
and pairs of 
simultaneous 
linear equations 

Define, evaluate, 
and compare 
functions 

Use functions to 
model 

relationships 

between 

quantities 


’Indicates a cluster that is well thought of as part of a student's progress to algebra, but that is currently not designated as Major by one or both of the assessment consortia in their draft materials. Apart from the 
asterisked exception, the clusters listed here are a subset of those designated as Major in both of the assessment consortia's draft documents. ** Depends on similarity ideas from geometry to show that slope can 
be defined and then used to show that a linear equation has a graph which is a straight line and conversely. 
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Consistent Progressions: Materials are consistent with the progressions in the Standards, by (all 
of the following): 
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engage students in problem solving. Materials for grades 6-8 also include problems in which 
students must make their own assumptions or simplifications in order to model a situation 
mathematically. Applications take the form of problems to be worked on individually as well 
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Coherent Connections: Materials foster coherence through connections at a single grade, where 
appropriate and where required by the Standards, by (all of the following): 
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Giving all students extensive work with grade-level problems. Differentiation is sometimes 
necessary, but materials often manage unfinished learning from earlier grades inside grade 
level work, rather than setting aside grade-level work to reteach earlier content. Unfinished 
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10. Emphasis on Mathematical Reasoning: Materials support the Standards' emphasis on 
mathematical reasoning, by (all of the following): 


UD 


CO 

r-f- 

3 

3 

~ H 

O 

~ s 
0 

0 

Q" 

0 

c 

c 

~ S 

0 

O 

3 

Q_ 

r-f- 

CO 

r-f- 

CO 

r-f- 

CO 

0 

c 

0 

“o’ 

— 

c 

3 


~ s 
CL 

0 

0 

0 

CL 

0 

3’ 

s 

3” 

O 

— h 

Q_ 

3 

1 t 

CTQ 

3" 

0 


C= O 

0 0 


K W 

a - 
0 
0 
3 


O co _ 


ft ° 


3 

CO 

Q era' 


0 

3 

0 


0 
3 

g- < 

0 CO 

a- w 
o o’ 
5‘ o 

r+ < 

3” 0 

0 £- 

3 0 

3 r— 1 - 

0 O 
Cf -1 
0 co 


0 

X 

r-f- 

0 

3 

CL 

"O 
0 
r-f- 
r-f- 
0 
~ s 
3 

CO 


0 

< 

CO 


0 

3 

Q_ 


O 

c 

co 

0 

r-f- 

3" 

0 

3 

0 

r-f- 

0 


QJ 0 

J7T O 

CO 

™ c 

T3 co 

o ro 

O" ^ 
0 

m -q 


CO 
0 
< 
0 
~ s 
0 
r-f- 

o 

0 

CO 

o_ 

C 


“D "D 
0 0 
— t ““ s 
CO CO 
0 0 
< < 
0 0 
— t t 

0 0 
3 


■a "D 

— s 

O 0 


n 

0 

3 ’ 

CTQ 


3 
co 

o_ 
< 
3 ’ 

0 OQ 
CL ^ 


O 

3 


0 


o r = 


0 

3 

0 

Q_ 

CL 

0 


0 

X 

“D_ 

0 < 

3* 

co 


~o 
0 
~ s 
— h 

o 

“ ^ 

3 

3 rS 
c ts 
=r rD ^ 

— 0 ^ 


0 
X 
“D 
~ s 
0 
CO 
CO 
~ s 
0 
CTQ 
C 


^ 1 

"D 0 

— t 

CL 


00 

CL 

O 

0 

CO 

3 

O 

r-f- 

CO 

0 

•< 


0 

— ■ 0 
2 3 

a- ® ' = 

-2 i 5 

0 S c 

i. - 5 

o 

CL T3 


QJ 
ft) 

l/l 

fD fD 
=3 X 
tn QJ 

0 3 

O “D 


0 

“O 

o 

3 ' 


CL Qj 
0 *< 
3 co 

r-f- -v 

^ c= 

CO co 
r-f- fD 


0 

r-f- 

0 

S 

0 

•< 


CO 

r-f- 

c 

CL 

0 

3 

r-f- 

CO 

C 


o 

cr 

0 

3 

CO 


s ^ ft 


Q_ 
O 
0 0 
3 co 
CL 


0 

3 


cr £ o 

^ pm — 


0 

0 

3 

3' 

CTQ 


UJ 

r-f- 

o 

0 

3 

O 


n 

E. 0 
n -a 
0 
0 


c_ 

0 


m 0 

X OQ 
n 


0 0 
cf ~o 
~o 


O bL 


0 

n 


n 

0 


UJ 


CTQ 

0 


O 
co 
0 
~ s 
0 
“O 
0 
0 
r-f- 
0 
Q_ 
n 
0_ 
n 
c 


0 

Q_ 
~ s 
0 
0 
CO 

O 

3 

3* 

CTQ 


0 

3 

CL 

“D 
0 
r-f- 
r-f- 
0 
~ s 
3 


O 

CL "O 
0 


CO 

o' 

3 

CO 

0 

a - 

o 

c 


CTQ 

r-f- 

3" 
0 

3 

0 

r-f- 

fD 

-i 

EL 

= w 
7T O “ 
fD p- 1/1 
S. CL 
O ^ fD 
era 1/1 


fD 

-< 

s 

o 

c 


< 

o 

n 

n 

0 

CO 

o' 

3 

0 


— • Q- ■< — 

At f A 


0 


3 

O 

r-f- 

0 

3 

O 

c 

CTQ 


3- 0 

O ?3 
g n’ 
< 0 

r-f- - ; 

O -<- 

C ’ i 

0 id 


5 § " 

fD y) 

d o 

< -* 

0 


CTQ 

< 

0 

C 

“O 


0 cn 

3 o 
■ . < 
_T 03 

r+ T3 

CO —1 

0 o 

< a - 

LA 

0 

3 

CO 


“O CTQ 
-5 3 

O 0 
o; cl 
0 


SB 

CO 


0 
7T 

fD o 

CO — 1 
0 

0 0 


HD 

Ln 

o S 

° -g 

co z: 
3 _ 

O 


0 


0 


o 

— f- 

"O 


n 

0 


a - Q 0 

— i ^ 

£5 n E- 

3 fD 

CO ^ > 


0 

3 

Q- 

0 


7? O 


0 

o 


0 

n 


n 

0 


"o cn 


0 

3 

Q. 

0 


3 rr 

o 

CO QJ 
0 r+ 

■< 0 


0_ 

CO 

0 

r+ 

r+ 

0 

3 

Q- 


0 


7s" 

0 

CO 


0 
O 3 
cr co 


3 

0 

0 

3 

5’ 

0Q 


co 

0 

< 


0 


0 

3 

CO 

0 

3 

Q_ 


0 

O 


0 

0 

n 


CL 

0 


I § 

fD ~0 

1 — h — 1 

S-- O 
5' 

fD O 


fD 

QJ 

tn 

O 


=5 LrL 

Cfq QJ 

r+ cr. 

O O 

1/1 =5 

=T “L 
fD 

cl -a 

_ tn 
Cfq' QJ 
C3 
Q. 

O — 

=5 C5 
— h fD 
O Qj 
-i —1 

3 ET 

5L | 

EL ft 

‘S § 

QJ 

QJ = 

W 3 - 

§ Cfq' 

fD_ 

— CO 
QJ D 
CO 3 " 
-h O 

c o 

3 — 

n _s 

cr. 3 

o 0 

—5 r-f- 

5 2 

-a 0 _ 

0 CO 

s- i. 

c CTQ 


0 

n 

c 


r-f- O r-f- 

fD 0 co 

■ft s m 

s § = 

< w TO 

5LL r 

1= =r o 

0 0 13 

co ^ 

•<0 0 

CO • 

r+ 0 ffq 

0 2 ?. si 

3 O r-f- 

-• 33 " 

5‘ ^ » 
cn -a o 
00 cr x 
=, ft M 

3 < O 
ft fD QJ 

in id a 

□ .=3 0 . 

QJ QJ r-t-* 

W CL o’ 
3 ft: = 

— - CT. r+ 

0Q o ^ 

ft = ft 

r QJ L 13 

b, 3 m- 

fD Q- 3 - 
-1 cn fD 
fD C u 
Cfq CT g 
co-'- 3 

QJ QJ X 

— 1 O 1—1 

Ilf 

^ o E. 

fD ^ cr. 

T 3 q T 3 

fD c — 
_ (-1 

— — ft 

Ilf 

0 g. r+ 

QJ —• 0 

to o cr 

0^0 

5 0 ^ 

3 *■+ 

CL 


0 


0 

X 

“O 


0 

3 § 


0 


0 

to. 

m* d 
0 - - 

3 

3 0 

r-f- 

ct 0 


0 

00 

r-f- 

0 

3 

CL 

0 


0_ 

CO 

c 

CO 
0 
~ s 
0 
"a 
0 
0 


3 

7\ 


0 

CL 


on rD 
" 0 
3 co 

I s 

3.g 

0 


CTQ 


"O 

bo 

0 

co 

0 

«~1- 

o 

o 


0 


< 

0 


3 

CTQ 

r-f- Q_ 

o -a 

3 - E -g 

s. § ft 


0 

CTQ 

E_ ? 

CD S-* 

3. 3" 

r+ 

< S 

3’ z 

n 

0 = r 
■a f+ 
0 0 


0 

x 

"a 


0 0 
0 


•< 

3 ’ 


CTQ 


0 

3 

Q_ 


O 

3 

3* 

CTQ 


n 

O 

3 

r-f- 

0 

3 


coherence. Examples: Materials connect looking for and making use of structure (MP.7) with 
structural themes emphasized in the standards such as properties of operations, place value 
decompositions of numbers, numerators and denominators of fractions, numerical and algebraic 
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the latter case, the solution to a problem takes the form of a cogent argument that can be 
verified and critiqued, instead of a jumble of disconnected steps with a scribbled answer 
indicated by drawing a circle around it (cf. MP.6). Problems and activities of this nature are 
grade-level appropriate, with a reasonable progression of sophistication from early grades up 
through high school. 
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explaining, justifying, showing, or proving. Students are asked to critique given arguments, 
e.g., by explaining under what conditions, if any, a mathematical statement is valid. Materials 
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Lack of alignment in these subjects could have the effect of compromising the focus and coherence of 
the mathematics Standards. Instead of reinforcing concepts and skills already carefully introduced in 
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Manipulatives are connected to written methods. "Research indicates that students' 
experiences using physical models to represent hundreds, tens, and ones can be effective if 
the materials help them think about how to combine quantities and, eventually, how these 
processes connect with written procedures." (Adding It Up, p. 198, emphasis in the original). 
For example, base-ten blocks are a reasonable model for adding within 1000, but not a 
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Lessons are thoughtfully structured and support the teacher in leading the class through the 
learning paths at hand, with active participation by all students in their own learning and in the 
learning of their classmates. Teachers are supported in extending student explanations and 
modeling explanations of new methods. Lesson structure frequently calls for students to find 
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The High School Publishers' Criteria are structured as follows: 

I. Focus, Coherence, and Rigor in the High School Standards 

II. Criteria for Materials and Tools Aligned to the High School Standards 
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Focus, Coherence, and Rigor in the High School Standards 


J For some remarks by Phil Daro on this theme, see the excerpt at http://vimeo.com/achievethecore/darofocus, and/or the full video 
available at http://commoncoretools.me/2012/05/21/phil-daro-on-learning-mathematics-through-problem-solving/ . 
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what they know and apply what they know to solve substantial problems. A college-ready curriculum 
including all of the standards without a (+) symbol in High School should devote the majority of 
students' time to building the particular knowledge and skills that are most important as 
prerequisites for a wide range of college majors, postsecondary programs, and careers. 
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Focus: focus strongly where the standards focus 


04/09/2013 


W 

00 

^1 


0 
n 
c 

L n 

1 

o 

r+ 

zr 

rD 


n 

O 

3 

"O 

O 

3 

rD 

Z3 

r+ 

CO 

O 


ro era' 
0) ^ 


rD 

CO 

r+ 

QJ 
13 
Q. 
QJ 
~ s 
CL 
co 

Q. 

O 

13 

O 


fD 

- E 

Q- n 

tO 


ro 

7s LO 

o ro 

s 

QJ 
< 
LO 


_ CTQ 

Q_ QJ 

fD 
13 


rD 


_ n 
9r O 


O 

3 

o 

fD 


£D 

—> r-t- 

rD 

n o 

rD =5 

LO </> 
^ -h 


5 £ 

fD H) 


O 

C 


fD 


1 1 

CT. C 

< ^ 

qj rD 


QJ ^ 

n 3 
7s" fD 
3 X 

0 

1 3 

rD 

cl si. 


era 


QJ 3 «— t- 

”* -+ QJ 

(D ^ ^ 

qj m rD 

v> </> 

s: 3 5; 

= rD 

CTO o 1/1 

r-l- — s — • 

rD < ~ ' 

QJ < 

n o 


3 

CTQ 


cr 

c 

— r+ 

S” ~ l 

rD qj 


= s 

LO ~< 
fD LO 

" rD 

r-t- i— t- 

w Z 

■-+ era 

3 m 

qj rD 

?r >< 
rD T3 
lo rD 
— n 


3 

QJ 

r_r r-t- 

Z n' 
E 1/1 

-s n 

3 o 

QJ C 
<— I" 

=5" £ 

ex n> 

° > 

ro ?+ 

| 3 

O 

r-l- r-l- 

rD it 
£ u fD 
n 

^ rD 
r+ 

£L 3 
^ 3 
n> 

LO 

O 

3 

rD 

n 

c 


o 

o 

c 

LO 

o 

3 

QJ 

T3 

"D_ 

o’ 

QJ 

r-t - 

o' 

o 

LO 


o 

. 3 
o rD 


LO 


LO 


c fD 

O LO 

fD ^ 
=3 "O 
r+ C 
^ =; 
qj rD 

i. 3 

^ DJ 


% rD 

Z 3 

_. DJ 

3 si 

qj n 

rf LO 


O (— t- 

QJ 

— QJ 
n 
7T 
O 

o 


fD 

CL 

C 

o 

QJ 


I- 


c c 

Z3 3 
Q_ Q_ 
fD fD 

— i 

LO LO 

r+ r-h 

QJ QJ 
13 13 

Q. Q. 
o’ O* 
era era 

| 5* 

r-t- qj 


E “ 

<-* =3 

QJ 5‘ 

8- <» 
3 ZD 
O c 

I s 

rD n 

cl < 

era. qj 

3 =3 

era cl 

3- 3 

QJ QJ 
*-+ Tv" 
=* =3' 

c era 

3 SL 
n era 
■< o 


i/i H 

o o 
3 CL 
rD dj 

r+ 

ra rD 

| s 

n -* 

C_ Z5. 

QJ O 

m E. 

r-t- QJ 

fD ZT 

LO QJ 
00 < 
— h rD 


c 

fD 
13 

■< Z 

^ I 


3 

o 


n -< 

O 

3 cr 
■a o 
c o 

r+ D 

S cr 
o' E 

| S 

3 1 °- 

o =;■ 


ro 

J3 cr 
E. 3 

C/l 


Z. C 


rD 


TO 

era 


o 

c_ 

CX QJ 
r-t- 

3 QJ 

QJ "O 

fD — 
LO O 
r-f- QJ 

C O- 

g- o 

fD 3 
=3 to 
to o 

3? =3 

-h a - 
o rD 

3 ^ 

o zr 

3 < 


fD 

to 

to 

fD 

"O 

QJ 


3 

o 

—t 

fD 


rD 

QJ QJ 


QJ 
O 

7T -i 

5 ^ 

o -o 

"O 

rD o 

Q_ QJ 

era n 
5' ^ 
era 5+ 


qj — 
to rD 


on 

O 

3 

rD 


rD 3- 

-5 ^ 

o 00 
2_ rD 

fD r+ 


5- 

7T lo 

o ^ 

-h n 

QJ O 

9r. n 

— *-> rD 

"O 


n 

O 

13 

n 

rD 

"O 


rD 

rD 

QJ 

to 

“O 

rD 

n 


r- 1 r 

Eo 


QJ 

13 


fD 

i I 


era 

o 


n 

QJ 


fD 

to 

"O 


fD 


rD 


c 

QJ to 
C?. O 
O "O 

P 31 

to’ 

r+ 

o’ 

QJ 

r+ 

fD 

Q. 

— h 

c 

fD 

13 

n 

fD' 

to 

O 

13 

r+ 

o 

“O 

o 


fD QJ 

ro. a- 

QJ tO 


rD 
n 
to’ 

o' 

o 

QJ 


rD 

“O 


rD 

un 


fD 
to 
fD £U 

3 i- 

QJ QJ 


r-t- n 
=5- o 
fD ^ 

o' ro 

KJ tO 

3 

3 o 

13 
Q_ 


fD 

C 

to 

rD 


Q — 


LO r-t- 

■< o 
3 =; 
Z era 

O rr 

o' O 


LO 

QJ O 


rD qj 
Q j r+ 


rD SLV 


rD 

X 

“O 

fD 

to 

to 


Q_ 

fD 


O 

era 

c 

QJ 

era 

n> 

to 

rD 

fD 


=5 

era fD 


fD 

QJ 


rD 


era 


o 

3 

C)0 


§ | 

10 rD 

13 


rD 


n 

- ro 

to LO 
" fD 
QJ 
13 
Q_ 


to 


qj zr 

~0 CD 
~r~ 

QJ 

n 

x-2 

era lo 

zr 

on o 

z = 

o 


n 

fD 

13 

r+ 

fD 
~ % 
fD 
Q_ 

O 

13 

Z3 

C 

3 

fD 


O 

o_ 

3 

QJ 

r-t- 

zr 

rD 

3 


3 

QJ 

r+ 

zr 

rD 

3 

QJ 


rD 

X 

“O 

0 

to 

to 

o’ 

o 

00 

QJ 

O 

Q_ 

fD 

QJ 

to 

O 

D 

o' 

era 


fD 

to 

rD 

fD 

X 

“O 

fD 

o 


rD 

X 

"O 

fD 

o 


o 

Z3 

LO 


c 

to 

o’ 

era 

3 

QJ 


a - 

c 


n 

QJ 


QJ 

O 


— era 

CL £Z 
to QJ 

era 


fD >: 


QJ 

o 

Q. 


fD 


O 

3 

r-t- 

zr 

rD 

n 

O 

o 

n 

rD 

r-t- 

fD 


3 ft ^ 

QJ QJ QJ 
r-t- O r-t- 

z ex 3- 

fD QJ 


CL 

to 


fD 

3 

LO QJ 

o d 
n 

Z- QJ 

fD — 

“O "U 


O z 

- I 

QJ =5 
-i QJ 
fD z!". 
n 

ro_ 5L 

QJ — 
r+ QJ 
rD =j 
ex era 

r+ ec 

o 

-h era 

— ro 

E QJ 

ro S 

n ex 


ro 

ex 3 

i/> QJ 


CL 

o 

3 

O 

I— t- 
LO 

fD 


n 

O 

o 

n 

fD 

“O 

r-t- 

c 

QJ 


O UJ O 


LJ. QJ 


QJ 

n 


s 2 

■S. K 

2. s 

^ rD 
fD = 
X 
“O 

ro 

o 


QJ 

to 

QJ 

n 

O 

o 

r-l- 

fD 

O 


o 

o 

to 
QJ 
O 
Q_ 
— h 
QJ 

era 

o 

“O 

“O 

o 

r-t- 

c 

o_ 

r~t ~ 

fD' 


C 

O 

CL 

rD 


QJ 

o 

Q- 

o' 

OQ 

QJ 

o 

CL 


QJ 

to 

(D 


o n 

QJ 

-h Zf - 

— rD 

E era 

ro o 

-j — ^ 

42 f . 

" O 
¥ ^ 


QJ 5 

? ro 

LJ QJ 

o’ L 

2i s 

o 


era 


c 

fD 

O 

n 

< 


3 

“O 

o 


LO 

n 


O 

o 

to 

QJ 

O 

CL 

3 

o 

Q- 

fD_ 

o’ 

era 


fD 


qj era 

=5 zr 

r+ 

cn 

= 3 - 

Z o 

era o 

is 


O 

o 


o 

CL 

ro_ 

o’ 

era 

to’ 

QJ 

LO 

r-t- 

QJ 

O 

CL 

QJ 


rD 


QJ 
“ s 
to 
*< 

3 

a - 

o 


fD 

rD 


ro 

S 

o 

CL 

c" 

o 

CL 

fD 


QJ 

O 

CL 


C 

to 

rD 

Q. 


qj ro 

7 + -o 


o 

o ro 

to fD 


QJ to 
to 


3 

rD 

ro 


Z T3 
rD rD 

< n 

< r+ r+ 

O 1/1 r+ 
3 0 3” 

ex -h ro 

-i S fS' 113 

— . era x 

era o td 

O 3 ro 

n. ^ . n 

" “TZ* r-t- 

QJ 


QJ 


to 

o n 
O 
o 
n 
n rD 
O -a 

Q_ r+ 

rD c 

QJ 


s 

o 


Q-o'? 

"5 =? c' 

o 
cr 
a> 

3 


c 

o 

CL 

rD 


QJ 


rD 

co 

r-l- 

QJ 

O 

CL 

QJ 

—i 

Q_ 

10 


10^ 

QJ 

O 

CL 


rD 

co 

r-t- 

QJ 

O 

CL 

QJ 

Q_ 

to 


O O 
o era 
fD '* 


o 

9r CD 
CL 

c 


n 

QJ 


to 

rD 

r-t- 

rD 

x 

“O 


fD O 
^ n 
eD a) 

r+ CL 

13" C 

fD Qj 

a> — 

" • to 
7T 


o 

fD 

fD 

Q_ 


— ^ ° 
— “O 
QJ C 

o 

CL 


rD 


3 

fD 

QJ 

o 

to 
rD 
-Q 

o ^ I- 


QJ 

fD 

c 

to 

fD 

Q_ 


to 
C 
zh CD 

Si 

n dl 


rD 

_Q 

c 

QJ 


— 1 

7J 


0 

7d 

ra' 

0 

Z3* 

Q- 


- s 

Z3 

~o 


era 

to 

r-t- 

c. 


r+ 

O 

CL 


cr 

rD 


c 

Z3 


“ s 


rD 

o 

3 

n 

O 
to 

r-t- 
QJ 
O 
CL 
Q_ QJ 

1 a 
< to 

=5 QJ 


fD 


ro 7s- 
rD rD 


era 

to 

-< 

O 

c 

n 

QJ 

O 


O" 

c 


CL 

QJ 


rD 

rD 

o 

c 


era 

yt 

a~ 

c 

r-t- 

*< 

o 

c 

n 

QJ 

O 

c 

to 

rD 


era 

to 

QJ 

to 


being held accountable for ever more discrete performances. If it is bad today when principals force 
teachers to write the standard of the day on the board, think of how it would be if every single 
standard turns into three, six, or a dozen or more microstandards. If the Standards are like a tree. 
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Informing purchases and adoptions. Schools or districts evaluating materials and tools for 
purchase can use the criteria to test claims of alignment. States reviewing materials and tools 
for adoption can incorporate these criteria into their rubrics. 
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II. Criteria for Materials and Tools Aligned to the High School Standards 


4 Slides from a brief and informal presentation by Phil Daro about mathematical language and English language learners can be found at 
http://db.tt/VARV3ebl . 
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For the sake of brevity, the criteria sometimes refer to parts of the Standards using abbreviations such 
as A. REMO (an individual content standard), MP.8 (a practice standard), F.BF.A (a cluster heading), or 
N.RN (a domain heading). Readers of the document should have a copy of the Standards available in 
order to refer to the indicated text in each case. 
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explicitly designed for focus, so that students spend the majority of their time on widely 
applicable work. 
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Table 1. Content From CCSSM Widely Applicable as Prerequisites for a Range of College Majors, Postsecondary Programs and Careers* 


Number and 
Quantity 

Algebra 

Functions 

Geometry 

Statistics and 
Probability 

Applying Key Takeaways from Grades 6-8** 

N-RN, Real 
Numbers: Both 
clusters in this 
domain contain 
widely applicable 
prerequisites. 

N-Q*, Quantities: 

Every standard in 
this domain is a 
widely applicable 
prerequisite. Note, 
this domain is 
especially important 
in the high school 
content standards 
overall as a widely 
applicable 
prerequisite. 

Every domain in 
this category 

contains widely 

applicable 

prerequisites. 0 

Note, the A-SSE 
domain is especially 
important in the 
high school content 
standards overall as 
a widely applicable 
prerequisite. 

F-IF, Interpreting 
Functions: Every 
cluster in this 
domain contains 
widely applicable 
prerequisites. 0 

Additionally, 
standards F-BF.l 
and 

F-LE.l are relatively 
important within 
this category as 
widely applicable 
prerequisites. 

The following 
standards and 
clusters are 

relatively important 
within this category 
as widely applicable 
prerequisites: 

G-CO.l 

G-C0.9 

G-C0.10 

G-SRT.B 

G-SRT.C 

Note, the above 
standards in turn 
have learning 
prerequisites within 
the Geometry 
category, including: 
G-CO.A 
G-CO.B 
G-SRT. A 

The following 
standards are 

relatively important 
within this category 
as widely applicable 
prerequisites: 

S-ID.2 

S-ID.7 

S-IC.l 

Note, the above 
standards in turn 
have learning 
prerequisites within 
6-8. SP. 

Solving problems at a level of sophistication 
appropriate to high school by: 

• Applying ratios and proportional 
relationships. 

• Applying percentages and unit 
conversions, e.g., in the context of 
complicated measurement problems 
involving quantities with derived or 
compound units (such as mg/mL, kg/m 3 , 
acre-feet, etc.). 

• Applying basic function concepts, e.g., by 
interpreting the features of a graph in the 
context of an applied problem. 

• Applying concepts and skills of geometric 
measurement e.g., when analyzing a 
diagram or schematic. 

• Applying concepts and skills of basic 
statistics and probability (see 6-8. SP). 

• Performing rational number arithmetic 
fluently. 


A note about the codes : Letter codes (A, B, C) are used to denote cluster headings. For example, G-SRT.B refers to the second cluster heading in the domain G-SRT, "Prove theorems using similarity" (pp. 77 of CCSSM). 


* Informed by postsecondary survey data in Conley et al. (2011), "Reaching the Goal: The Applicability and Importance of the Common Core State Standards to College and Career Readiness," 
http://www.epiconline.org/publications/documents/ReachingtheGoal-FullReport.pdf . 

** See CCSSM, p. 84: "...some of the highest priority content for college and career readiness comes from Grades 6-8. This body of material includes powerfully useful proficiencies such as applying ratio reasoning in 
real-world and mathematical problems, computing fluently with positive and negative fractions and decimals, and solving real-world and mathematical problems involving angle measure, area, surface area, and 
volume." 

* Modeling star (present in CCSSM) 

0 Only the standards without a (+) sign are being cited here. 


04/09/2013 


° See the PARCC Model Content Frameworks for Mathematics for additional examples of specific fluency recommendations: 
http://www.parcconline.org/mcf/mathematics/parcc-model-content-frameworks-browser . 
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Rigor and Balance: Materials and tools reflect the balances in the Standards and help students 
meet the Standards' rigorous expectations, by (all of the following, in the case of 


Lasting Achievements in K-8. 
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Additional aspects of the Rigor and Balance Criterion: 

(1) The three aspects of rigor are not always separate in materials. (Conceptual understanding 
and fluency go hand in hand; fluency can be practiced in the context of applications; and brief 
applications can build conceptual understanding.) 


materials include an ample number of high-school-level problems that involve applying key 
takeaways from grades K-8; see Table l. 7 For example, a problem in which students use 
reference data to determine the energy cost of different fuels might draw on proportional 
relationships, unit conversion, and other skills that were first introduced in the middle grades, 
yet still be a high-school level problem because of the strategic competence required. 8 
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Allowing teachers and students using the materials as designed to spend sufficient time 
working with engaging applications/modeling . Materials include an ample number of 


them to deal explicitly with domains. They learn about expressions as recording calculations 
with numbers, and then extend them to symbolic objects in their own right. The materials 
make these extensions of prior knowledge explicit. Thus, materials routinely integrate new 
knowledge with knowledge from earlier grades. 
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Coherent Connections: Materials foster coherence through connections in a single course, 
where appropriate and where required by the Standards, by (all of the following): 


and http://www.psychologicalscience.org/index.php/publications/observer/2013/april-13/true-grit.html. 
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Careful Attention to Each Practice Standard: Materials attend to the full meaning of each 
practice standard. For example, MP.l does not say, "Solve problems." Or "Make sense of 
problems." Or "Make sense of problems and solve them." It says "Make sense of problems and 
persevere in solving them." Thus, students using the materials as designed build their 
perseverance in course-appropriate ways by occasionally solving problems that require them to 


CD 


QJ fD 

5- ~o 

fD QJ 
r-F 
r-F CD 
=3- Q_ 

3 CD 
-i QJ 
CD in 
~ O 
13 


•< 

d' 

era 

o 

13 

3 

fD 

3 

o 


13 

era 


c 

D 

o 

r~F 

o' 

o 


fD 

in 

CD 

QJ 

O 

Q_ 


O 

=3 “O 

era fD 

s. S’ 
? 3 

o c 
m ST 

3 I 


3 ,S. 

era 

n 

9. -Q 

QJ C 

QJ 

o’ cr. 

=3 o 
o 

On 

— h 

o 

~ s 
in 

<—F 

QJ 

era' 


13 

C 

3 

fD 

o’ 

QJ_ 

fD 

X 

QJ 

3 

■o_ 

fD 


S’ S 

=5" =r 

r+ CD 
IT -i 
CD ~0 


QJ 

n 

t— F 

D* 

fD 

in 

n 

QJ 

13 

cn 

C 

“O 

“O 

o 


0 

n 

c 

Ln 

1 

— h 

o 

fD 

X 

QJ 

3 

~o_ 

CD 

a~ 

~< 

3 

o 

< 

o’ 

era 


c 

Q_ 

CD 

13 


CD 

— h 

o 

— s 

3 

o 

— Ft 

fD 

_Q 

C 

QJ 

i— F 

o’ 

13 


< 

CD 

CD 

X 

“O 

fD 

cn 

oo 

o’ 

O 


o 

3 


fD 
“O 
CD 
QJ 
«— F 

CD 
Q_ 
~ s 
CD 
QJ 
oo 
O 
D 

o’ 

era 


“O 

bo 


CD 

o. 


era 


Q_ 

fD 


c 

o 

n 

i—F 

o' 

o 

Q- 

fD 

— h 

o’ 

CD 

Q_ 

a - 

*< 

QJ 

o 

CD 
X 
“O 
~ s 
fD 
oo 
in 

o’ 

O 

CD 

r-F 

O 

3 

QJ 


“i. fD 


QJ 

era 

fD 

a~ 

“ s 
QJ 

QJ 

O 

Q- 

— h 

c 

o 

n 

r-F 

o' 

o 

y> 

p 

era 

a - 

*< 

on 

C 

3 

3 


o 

era 

“ s 
fD 
“O 
CD 
QJ 
r-F 

CD 

Q_ 


O 

o’ 

era 


c 

n 

r-F 

c 

~ s 
CD 

O 

— F 

QJ 

O 

fD 

X 

“O 


c 

on 

fD 

5" 

O 

7 -r 

o’ 

era 


QJ 

o 

Q_ 

CD 
X 
“O 
~ s 
CD 
on 
in. 

o’ 

era 

“ s 
CD 

era 

c 


CD 

on 


O 

O 

r-F 

o 

QJ 

— Ft 

CD 

QJ 

r-F 

c 

~ s 
CD 

O 


CD 

r-F 

in 

n 

O 

o 

r-F 

fD 

X 

r-F 

era 

QJ 

on 

“O 

o’ 

era 


CD 

cr 

fD 

o - 

QJ 

< 

o’ 

o 


n 
O 
=r 
fD 
~ s 
CD 
O 
n 
fD 


CD 

3 

fD 
on 

CD 

3 

“O 

O" 

QJ 
in. 
ni’ CD 
fD O, 
Q_ 


QJ 


CD =' 


fD 


QJ 
O 
Q_ 
QJ 
~ s 

Q. 

y) 

on 

c 

n 

o - 

QJ 

on 

“O 

C 

“O 

o 

on 

CD 


O 

era 

fD 

x 

“O 

fD 

on 

o’ 

O 

on 


“O 

n 

-n 

CL 

CD 

“ s 

O 

O 

CD 

X 

QJ 

3 

n 

< 

"D_ 

O 

(— F 

3 

c 

fD 

QJ 

o’ 

CD 

on 

re 

n 

r+ 

5‘ 

on 

QJ 

3 

Q_ 

O 

“O 

3 

5* 

r-F 

cr 

QJ 

00 


CD 

CD 

D 

CL 

"D 

i I 

O 

13 

r-F 

~ s 

o 


qj QJ 
n 


Q_ 
on o 
qj fD 


fD ^ 


O 

O 

o' 

era 


QJ 

o 

Q_ 

3 

QJ 

x; 

o' 

era 

c 

on 

fD 


O 

o 

r-F 

n 

o 
o 
o 

CD 
n 

r-F LJ. 

CD 3" 

CL n 


3 5 

fD rt 

n fD 
O- O 
Qj r+ 
O r+ 

on’ 


n 

QJ_ 

■<" 

o 

“ s 
~ s 
QJ 
O 
Q. 
O 

3 

< 

a - 

c 


CD 

QJ 

Q_ 

on 

C 

“O 

“O 

o 


o 

n 

c 

on 

QJ 

O 

Q_ 


fD 


fD 
O 
n 
V) fD 


QJ 

O 

Q. 

QJ 

a. 

on 


QJ 


< t 

5* 

-a 

QJ 

n 

rt 1 

n’ 

fD 

LO 

r+ 

QJ 

O 

Q. 

QJ 

OL 

on 


QJ 


QJ 


fD 
fD 

1 . 

3" "D 

n» ^ 

in O 


IM 

(t> 

a. 


=- — . fD 


a> 

-• to 
3 r+ 
in at 


3 

Q. 

at 


O 

o 

c 

m 

at 

3 

Q. 

n 

O 


a. ^ 

m fD 

n | 

CD 
O 


O" 

< 


QJ 

o 

Q. 


3' "9 


fD 

“O 

QJ 

n 

r-F 

o’ 

fD 


QJ 
O 
Q. 
QJ 
~ s 

Q. 

on 


O" 

fD 

n 

QJ 

on 

on 

~ s 
O 
O 

3 

QJ 

O 

CL 

o’ 

on 

r-F 

c 

CL 

CD 

O 


3 

QJ 

r-F 

O" 

CD 

3 

QJ 

r-F 

n 

QJ 


QJ 

“O 

"O 


CD fD 
< 


o 
< 
o' O 
tr - qj 

<*> n 


CD_ 

QJ 

“O 

“O 

o 

“O 

qj’ 

r-F 

fD 


QJ 

“O 

“O 

o 

“O 

Qj" 

r-F 

fD 


on 
C 

era 

era _ 

fD 9 

on QJ 
O 


O 

o 

on 


C 

CL 

CD 

O 


QJ 

era ^ 


o 

o’ 

era 


n 

O 

o 


on O =3 


CD n> 
O. n 
qj’ O 

^ 3 

EL fD 

on 


CD 

O 


0 

n 

c 

Q. 

fD 

r-F 

fD 
QJ 
n 
O" 
fD 
~ s 

1 

a. 

“ s 
CD 
n 

r-F 

CD 

Q_ 


CD 

n 

O 

o 

r-F 

fD 

O 


fD_ 

“O 

on 

r-F 

c 

CL 
fD fD 


fD 

3 ^ 

QJ QJ 

m £ 

3- sj 


fD 

“O 


QJ 
O 
CL 
QJ 
~ s 
CL 
on 


QJ 

r-F 

fD 

o y 

on 


S. “ 

fD 
QJ 
n 
n 
O 

3 

“O 
QJ 
O 


Q_ n — • 

S" ^ 

— on CL 
< r-F 

« S - 

CL QJ 


a - 


o 

Q_ QJ 
QJ 


~ s *< 
CD t/>. 

qj 

* i 

QJ 

3' 

CD 
Q_ 
QJ 


O 

O 


fD 

< 

^ QJ 

o cr. 5- 3 r 


o 

n 

o 

3 

r-F 

fD 

O 


QJ 

n 

O" 

QJ 

"O 

"0_ 

o’ 

QJ 

fD 

n 

O 

c 


c 

QJ 

r-F 

o 

“ s 
p 

o 


CD 

QJ 

c 


O on QJ 

fD CD < 


QJ 

O 

Q. 


CD 


fD 

X 

“D_ 

QJ 

O 

QJ 

r-F 

o' 

o 

on 


QJ 

era 

— s 
QJ 

3 

y> 

3 

QJ 

r-F 

O" 

CD 

3 

QJ 

r-F 

n 

QJ_ 

3 

o 

CL 

CD_ 

y 

CD 

r-F 

n 


The practice standards are not just processes with ephemeral products (such as conversations). 
They also specify a set of products students are supposed to learn how to produce. Thus, students 
are asked to produce answers and solutions but also, in a course-appropriate way, arguments. 


into explicit and precise claims. 


o 

-p* 

o 

kD 

ro 

o 


=5 O 

cu q 
7T =3 
fD fD 


Q. 

n 

O 


3 
o 

fD 

— h 

o 

3 21 3 

cr m S 

QJ — 


era 

c 

3 


QJ Q_ 

S" P 


! 3 . r-h fD 


fD_ 

< 


O 

Q_ 


3 

T 3 


s 1 


fD 

T 3 

O 


3 

T3 


O 

n q 
fD => 

O 3' 

^ — h 

fD O 

=r. 3 
3 92. 

fD 


n cd 

5 era 
c 

3 

rD 

o 


3 =3 

QJ < 


o 


o 

cr 


“D 

o 
o 

Q_ 

0 ) 

O 
n 
fD 
in fD 

a- 3 

s - 

§ §- 

ro <. 

fD 3 
o era 


3 « 

3 CO 

0 ) in 

Cft. “D 


n 

0 ) 


fD 

n 

qj ft 

3 N 

Q- ro 


< 

0 ) 

r+ 

r+ 

fD 

3 

a. 


QJ 
n 
QJ £ 1 ) 

re" to 
3 £ 


3 

cl ora 


ro 

— m o' era <n 


QJ 

O 

Q. 


QJ 
O 
CTQ 

£ 3 
era dj 
ro 

cu ro 

S. 3 

QJ 

3 ? 

c 


_ fD 
QJ 
O 
CTQ 
C 
QJ 
CTQ 
fD 


T3 
fD 
O 

m 5 ‘ 
fD — 


fD 


INI 

fD 


±_ 2 


o O- 

fD QJ 

3 


rl qj 


"a 5 
ro 73 

3 f 
ft 3 


rD 


q ora 

3 c 

ft CD 

rD ora 

(D 


Q- o/ O 

g CO -h 

s' oj g 

= 3 " 3 Q, 
r+ CL rt- 


O 

3 


rD 

r+ 

QJ 

C 

CTQ 


fD 

3 

QJ 
(— h 

n’ 

QJ_ 

~ s 
fD 
“D 

fD 


fD QJ 
3 r-f 

*-+ O" 
H. fD 
Cr. -* 

O r+ 

13 = 3 - 

in qj 
— 3 

ft CD 

— IS) 
C in 
CL C= 

5 ' 3 
era fD 
a. 


O CD 

ft 3 

to QJ 


QJ 

3 CD 

ao-n 

QJ Q. 


m 


a. fD <; 

^ c/> CD 


fD fD 


fD 

< 

fD_ 

O 

73 

3 


fD 

3 

QJ 

(-+ 

o' 

QJ 


— in O rD co 


~n 3 


ft 3 
■~ h era 


3 ro =r 

C o, ID 
o ^ — 
ft fD ft 

Cl qj 

C 3 o 
-< CD. QJ 


Qj 

| 

O 

era 

QJ 

n 

n 

fD 

QJ 

O 

c 

o 

Q_ 


_Q 

C 

fD 

Q_ 

3 ' 

in 

r+ 

fD 

QJ 

Q. 

O 

— h 

QJ 


C 

<-*■ 3 

rT Z 

-h fD 


cr» m 
" n 


-* QJ 

qj 

ln era 

IS) r- 

5 . 3 

cr id 

c r 3 

113 ft 

QJ QJ 


(S) 


CD 


n 

QJ 

O 

cr 

fD 


a - 


Engaging students in problem solving as a form of argument. Materials attend thoroughly to 
those places in the content standards that explicitly set expectations for multi-step problems; 
multi-step problems are not scarce in the materials. Some or many of these problems require 
students to devise a strategy autonomously. Sometimes the goal is the final answer alone (cf. 
MP.l); sometimes the goal is to lay out the solution as a sequence of well justified steps. In 
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explains how the full meaning of each practice standard has been attended to in the materials. 
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when working in pairs, if ELLs are paired up with a student who shares the same language, they 
might choose to think about and discuss the problems in their first language, and then worry 
about doing it in English.) 
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Age-appropriateness 

Freedom from bias (for example, problem contexts that use culture-specific background 


http://commoncoretools.me/2011/06/15/essay-by-jason-zimba-on-pinnacle-standards/ 




o 

-p* 

o 

LD 

NJ 

O 


c 

O 

0 

> 

to 

0 

0 

~ \ 
0 

(— y 

to 

r+ 

— \ 
0 

Q_ 

5‘ 

QJ 

0 

to 

“ ^ 
0 
r-y 

0 

to 

— h 
0 

Q_ 

o’ 

0 

O) 

o’ 

crq_ 

H 

0 

r-y 

Q_ 

73 


=T 

0 

< 

T3 

a - 

~< 

0 

Q_ 

o_ 

UJ 

0 

0 

~h 

0 

>< 

*< 

3’ 

r-t- 

c 

3 


s 

to 

=r 

& 

0 

0 

O 

=T 

0 

_Q 

0 

bo 

0 

S 

r-t- 

C 

‘0 

Isj 

S 

to 

IT 

0 

< 

to 

3 

0 

0 

O 

r+ 

0 

r—y 

cr> 

s 


Cjl 0 
X 

0 Qj 


Ln -j 

fD =5 
to "O 
^ fD 


O 

— h 

o 

3 


— fD 


CL 

C 


-• fD 
=5 fD 


Q_ 

C 


3“ fD 

a- zj- =T 

S ro <§- 

Ey- =5- 

— ' l o 

r-t- ^ n 


fD 


fD 

QJ 


CTQ 


O 

CTQ 

— t 

fD 

tO 

tO 

o’ 

o 


QJ 

O 

Q_ 

QJ 

Q_ 

tO 


O 

o_ 

a - 

c 

r—y 
QJ 
— * 
fD 

3 

fD 

QJ 

13 


fD 

co 

fD 

QJ 

fD 


q QJ QJ 


o 

o_ 

co 


— O 


o 

OQ 


QJ 

“O 

“O 


fD “■ 


7s 

I 

00 


fD 


fD rD 
Q- CTQ 
— fD 
=3 " 

§ 

o 


o* 

CTQ 


fD 


tO 


QJ 

n 

fD* 

< 

fD 

3 

fD 
3 
r—y 
LO 
— h 
“5 

O 

3 


r-t- 

r— y 

1 

=r 

=r 

00 

0 

“D 

§ 

uo 

r—y 

0 
— s 

0 

0 

n 

c 

Q_ 

0 

Q. 

0 

r-t- 

* 

“ ^ 

0 


Q_ 

CTQ 

n 

to 

0 

c 

CO 

to 

Q_ 

0 



tTT 

bo 

73 

S 

0 


UJ 


0 

0 

13* 

r—y 


0Q 

=r 

^sj 


>i o 

m ^ 
m rD 

uo rD 

■ ■ x 


DO <■ 

^ ^ 
QJ O 
=5 X! 

a. o 

£ g. 

O o 

-l 13 

^ QJ 

TO fS 


3" O 

Si I 

fD 31 

QJ -q 

to 

= ^ 

s 

n c 
fD Z5 


3- 

a> 

5 

Q 


O 

3 

■3 

c 


3 

f~y 

3 

05 

QJ 

~o 

3 

LO 

0 

0 

Q_ 

fD 

fD 

a 

O 

0 

Q 

fD 

to 

r+ 

3 ' 

■a 

■a 

0 

—i 

O 

■a 

fD 

C 

3 

cr 

O 

< 

fD 

3 

“D_ 

o_ 

fD~ 

era 

05 

< 

fD_ 

<-y 

O 

t3 

n 

fD 

D 

Q 

3 

QJ 

r-y 

0 ’ 

■a 

qj' 

r—y 

CD' 

fD 

to 

3 

c 

0 

O 

fD 

QJ 

O 

■a 

3 


o 

3 

05 

Q 


a » ^ 

?:s “ 
§ S S. 

q era jd 

7* n>‘ £ 


3 7 . 

£1) LO 


05 


05 

a 

<-+ 

3- 

to‘ 

05 

to 

<-+■ 

3 

Q 

<-y 

05 

o 

Q 

3 

cr 

05 

c: 

to 

05 

CL 


.0 § 

"* 3 
8 ^ 
Q 

*5 ^ 

Q Q 

?. 5 

CT o 


~n 

o 


2 <* 


fD 

QJ 

to 

O 

3 

Q) 

fD 

3 

fD 


O 

3 


3 £L 


o o » 

n ^ Q_ 

O c =3 

£ 3 X 

“ cr t 

« £ 5 

C to 3 

< ' QJ 
r+ r~* ~ 

zr & n 


LJ -3 " 

^ 3 =5 
Vy Q £ 
No < 

In 3' £ 

C5 eQ to 

L la c 

hj E. 

~s Ln 3 

q era 

= 3 

| s 


3 

c 

3 

cr 

fD 


O 2 
3 o 
y* g: 

QJ fD 

3.3 


3 

•< 


Q 

o 

Cr 

05 

n 

O 

3 


Vy g 

\j os 

o 9. 

■ to 

sc to 
O 3- 
C 05 

S § 

Q ^ 

=3 


3 fD 
£ °- 
to ^ 


c -> 
to T3 

3' O 

era <£. 


fD QJ 
fD r+ 


tO QJ 
to 3 

Q_ 
3 
fD 

era 


3 

Q_ 


n 


QJ 


“J. < 

•< "> 

> I. 

1. 1 

*< QJ 


QJ 

to 

r+ 

QJ 

3 

Q_ 

QJ 


fD 

— h 

fD 
~ 1 
to 


to 

7T 


fD 

3 

QJ 


3 

■0 
o 
— ^ 
r — h 
QJ 
3 


fD_ 

a - 

fD 

< 

o 

3 

Q_ 


Q_ 

Q_ 

fD 

to 

n 

3" 

O 

O 


O fD 

r+ 3 
IT ^ 
fD 

^ O 

a- 3 

o 3 
^ y» 

fD ^ 
Q_ 


Q_ 

fD 

< 

fD_ 

O 

~o 

fD 

Q_ 


QJ QJ 
n Z3 


cr O 


fD 

Q_ 

cr 

< 

QJ 


r ro 

fD 

3 n 
Q_ QJ 


-■ n 

a § 

Q_ fD 
fD 2 . 


T3 

O 


ffi “ fD O J 


3 

T 3 

O 


p' fD 

E_ era 

fD 


O *< 


cr 

fD 

< 

QJ_ 

ol 

QJ 

r-h 

fD 

Q_ 

cr 

•< 

to 

C 

cr 

to 

fD 

JD 

C 

fD 

D 

r-h 

T 3 

fD 


Q_ 

fD 

to 

cn 

l 

CX5 


fD r+ 

3 » 

tO QJ 

Q_ 
QJ 


fD 

ni to ts «-+ 


O 

3 

■a 

c 

r+ 

IS’ 

era 

~+i 

c 

fD 

=3 


cr qj 
o =5 
c cl 

QJ QJ 

n 

■< r+ 

CL O' 

n - 5 


m 3' 

CL T 3 

o- 2 

■< r+ 


Q. fD 
fD 2 
=3 2- 

Q. 3 ' 

fD fD 
to to 


-COn 

i- - = 

CT fD fD 
o qj era 
to" 9- fD 

QJ 
3 


3 

fD 


O 


o 

3 

3 " 

era' 

3 ” 

fD 

fD 

CL 

C 




QJ -i 
2 -. n 
° 

era = 

O fD 

o 

fD 


fD 

era 

fD 

QJ 

3 

CL 


3 

QJ 

3 

n 

fD 

O 


C 

Q_ 

fD 

3 


fD QJ 

era 3 

fD Q_ 
QJ n 
3 QJ 
CL 


to 

C p 

n O 

=■ 3 

QJ fD 
to to 

QJ = + 


73 -5 0 

o 3 

to *< -* 

_ (7) 


3. Z3 

< era 
f® —1 

QJ QJ 
3 3. 


fD 

QJ 

Q. 

3’ 

fD 


fD 

=; ^ 1 

s £ 

-t 9: 
fD 3 

Q_ <* 

5' 1/1 

fD ^ 
to CJ 
to fD 
to Q_ 

? ft 

C 

s g - 

£ r? 

K CL 


— - QJ 

115 m g 

3 * | 

£ S = 

to — h era 


CL 

fD 

to 

cr» 

l 

00 


cr 

o 

CL 

■< 


3 
05 Q_ 
to C 

sr s- 

3 f® 
O QJ 

qj era 

Q- fD 
to QJ 
r-t- 

3 CL 
Q_ fD 
fD QJ 
CD ~ 


Q_ O < 


O 

3 

to 

QJ 

3 

Q_ 

Q_ 

fD 


fD 

QJ 


fD 

QJ 


•S QJ 

O “ ' 
ZL 05 
CL =5. 
qj 9L 
3 
CL 


3 a 

QJ fD 

r+ Qj 
3“ — s 
fD 

3 ^ 

QJ ZT 


^ =5 

rt- o 

o S 


era : 
-! "D 
QJ — 
CL =5 

ru =s 

QJ 

rD Q 
< rD 
fD to 


O 

CTQ 


to 

O 

3 

rD 


qj rD cT. o 

' “ " 3 : 

rD -r 

to 

3 

QJ 

7T 00 

fD 


CD 

QJ 

Q. 

3* 

CD 


— 


5* 


S 

3 

=r 

0 


to 

n* 

r— y 

=r 

0 

r—y 

— h 

=r 

r—y 

0 

=T 

*< 

0 


3 

“D 


“D 

3' 

0 

r—y 

0 

=r 


0 

H 

=T 

3 

to* 

CL 



Q_ 

to 


to 

0 

crq’ 

crq 
— % 


0 

0 

CL 

0 

0 


fD 


fD 

7s 

I 


fD s: 
QJ to 
fD 


fD 


n 

O 

r-f- 

fD 


fD 

3 

Qj 'A 

to QJ 
=: =5 
Q_ 
QJ 
— ^ 
Q_ 
to 


— — • =5 


QJ 

< 

OQ 
<* 
fD QJ 


3 5- 


QJ 


=3 

0 Q 


n 

QJ 

"D 


to 


n 

fD 


fD 

LO 

r+ 

QJ 


05 

Q_ 

era 

fD 


fD 

3 

D SJ. 

Q_ 13 
qj — 

2-1 

1/1 T3 

r+ O 

rD qj 

§ P 
2. ST 
< -1 
rD q- 
1/1 rD 

2 i- 


fD 

“D 

QJ 


r+ ^ 

o rD 

^ X 
n> to 
to rf 


QJ g 

i.1: 

qj n 

3. - 

to 

0 X 

%% 

to 


QJ 

Q_ 

QJ 


O 

C 


3 n> 

fD ^ 
^ fD 
n >< 

Q) " 

= o 

r+ 13 

=T fD 
fD — 

3 = 

=T 

0 


> 

I 

CD 

I 

3^ n 

rD 5 - 

to 

QJ QJ 

m" ~o 
0 ^ 

O O 

— h CTQ 

0 

CO 


O 

3 


n 

0 


pi 

Co 

1 — 

[> 

Co 

0 

73 

0 

XC 

to 

r-y 

73 

C3~ 

^* 

fD 

x: 

crq 

3 


> 

CL 

Q 

n 


to 

O 

3^ 

x’ 


0* 


Nj 

< 

0 


3' 

3 


O' 

0 


CD 

D 



r— y 


<■— 

to 



5* 



7s 


eri 

1 

00 


Kj 

0 

k-a 

Nd 




uj 


04/09/201; 


o 

CO 



o 

n 

r+ 

n 

< 

O 

o 

O 

CD 

— 

— 



n> 

CD 

CD 

CD 

crq 

CO 

CfQ 

— 

CD 

—• 

CD 

— h 

CD 

3 

CTQ 

n 

O 

3 

CD 

:> 

Q_ 

n 

CD 

n 

3" 

— t 

CD 

m 


03 

fD < 
CD CD 


CD 5 

a. 


^ 3" 

03 03 

l/i -i 
</l 03 

i ^ 

era' :± 

s - 

O) 3- 

£ m 

■< -i' 

cr =;' 


03 

3 


on r+ 
l/l Q3 

S =5 

n 

-■ 03 


< 

03 


03 

l/i 


03 

T3 


fD TO 

o <* 

CL ui 


03 

3 


o 

3 


Z3 ^ 
03 O 
l/l 3 

l/l i/i 


l/l 

o 


03 

CL 

“i 

03 


O 

era 


O 

03 


03 fD 

l/l QJ 
!£ 00 
O' o 


o 

era 


o' ■ E> 

P | 

O 03 

ro 4/ 
Fd n 

03 n 


o. 

CL 

03 

on 

n 

O" 

o 

o_ 

in' 

03 

n 

O 


03 

~2. -o 

I “ 

Q. fD 
fD CL 

1/1 T3 
03 3 

s 85 

"a a> 


CD 

“1 

CL 


era 


O "a 


03 


03 



As shown in the figure, standards like 7. EE. 3 are best thought of as descriptions of component skills 
that will be applied flexibly during high school in tandem with others in the course of modeling tasks 
and other substantial applications. This aligns with the demands of postsecondary education for 
careers and for a wide range of college majors. Thus, when high school students work with these 
skills in high school, they are not working below grade level; nor are they reviewing. Applying securel 



standards as well as the demands of the high school standards and readiness for careers and a wide 
range of college majors. 


